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Abstract 

KaowLedge  about  the  structure  of  arithmetic  expressioas  enables  people 
to  reason  effectively  about  such  expressions.  Including  an  ability  to 
judge  equivalence  under  transformations.  This  paper  reports  an 
empirical  study  of  six  middle-school  children  who  judged  the 
equivalence  of  three  sets  of  three-term  arithmetic  expressions  with  an 
addition  and  a  subtraction  operator.  Analyses  of  thlnklng-aloud 
protocols  on  this  task  reveal  that  the  students  (a)  use  several 
different  methods  to  parse  and  judge  the  equivalence  of  such 
expressions,  (b)  sometimes  use  a  different  parsing  or  judging  method 
with  the  same  expression,  depending  on  which  expression  It  Is  compared 
against,  and  (c)  are  able  to  work  with  different  conceptual 
Interpretations  of  expressions.  Additional  results  are  provided  about 
specific  errors  that  were  made  and  trends  In  the  students'  application 
of  these  methods.  The  results  are  discussed  briefly  along  with  three 
comments  on  their  educational  implications. 
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Prealgebra  Students'  Knowiedge  of  Algebraic  Tasks 
With  Arithmetic  Sxpressions 

The  general  hypothesis  motivating  this  research  is  that  students 
will  learn  algebra  more  readily  and  with  more  understanding  if  they 
first  learn  algebraic  concepts  applied  to  arithmetic  expressions,  and 
can  understand  how  these  concepts  are  used  to  perform  algebraic 
operations  on  arithmetic  expressions.  For  example,  we  suppose  that 
students  would  be  better  able  to  learn  algebra  if  they  already 
understood  concepts  such  as  commutativity  and  unary  parsing  (i.e., 
keeping  the  sign  with  the  number)  in  the  context  of  arithmetic 
expressions  and  could  use  them  to  perform  such  algebraic  tasks  as 
judging  the  equivalence  of  two  arithmetic  expressions.  This 
hypothesis  is  particularly  relevant  to  the  educational  goal  that 
students  should  understand  algebra  as  generalized  arithmetic  C^^leran, 
in  press) . 

As  a  first  step  in  exploring  this  general  hypothesis,  we  assessed 
what  prealgebra  students  know  about  the  structure  of  arithmetic 
expressions.  More  generally,  knowledge  of  structure  is  knowledge 
about  the  mathematical  relationships  among  the  elements  of  a 
mathematical  expression.  This  knowledge  is  needed  to  perform 
mathematical  operations  on  both  arithmetic  and  algebraic  expressions. 
For  example,  knowing  how  to  interpret  arithmetic  expressions  includes 
knowing  that  an  operator  only  applies  to  the  number  immediately  after 
the  operator  (when  there  are  no  parentheses) ,  or  that  a  -h  b  -h  c  could 
be  grouped  as  a  -h  b  and  £  or  as  ^  and  b  -h  c.  Knowledge  of 
transformations  that  preserve  equivalence  includes  knowing  that  a  4-  b 
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'4e  presume  that  kaowLedge  about  structure  Is  embedded  la  the 
performaace  of  a  variety  of  mathematical  tasks  such  as  laterpretlag 
expressloas,  computing  the  values  of  expressions,  Judging  the 
equivalence  of  expressloas,  and  performing  transformations  on 
expressloas  that  preserve  equivalence.  Vfe  believe  that  characterizing 
knowledge  about  the  structure  of  arithmetic  expressloas  will  provide  a 
general  way  for  describing  students'  knowledge  of  algebraic  concepts 
and  how  to  use  them  In  specific  algebraic  tasks. 

Structural  knowledge  need  not  be  explicit  to  the  student.  What 
we  are  thinking  of  here  Is  roughly  comparable  to  the  Idea  found  In 
linguistics  that  we  can  generate  grammatically  correct  sentences,  that 
Is,  ones  that  obey  the  structure  of  the  language,  without  necessarily 
knowing  explicitly  the  structural  rules  being  obeyed.  By  analogy, 
people  can  operate  within  the  structural  constraints  of  an  arithmetic 
expression  without  explicitly  knowing  those  constraints. 

One  Important  task  that  hinges  on  knowledge  about  the  structure 
of  expressions  Is  the  ability  to  Identify  and  preserve  equivalence. 
Equivalence  Is  fundamental  to  mathematics.  In  algebra,  all 
transformations  on  expressloas  (e.g.,  solving  equations,  or 
simplifying  and  factoring  expressions)  must  preserve  equivalence.  In 
arithmetic,  one  must  not  change  the  values  of  numbers  In  the  course  of 
calculations . 

The  research  reported  here  attempts  to  Identify  aspects  of 
structural  knowledge  embedded  In  the  performance  of  an 
equivalence- judging  task  by  prealgebra  students  In  middle-school 
(grades  6-3).  The  task  Involves  judging  the  equivalence  of 
three-term  arithmetic  expressloas  with  addition  and  subtraction. 
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without  coaputlng  any  values. 

We  can  lafer  knowledge  about  the  structure  of  arithmetic 
expressions  from  performance  on  this  task  because  it  requires  the 
students  to  interpret  and  compare  transformed  expressions.  We  assume 
their  procedures  must  reflect  aspects  of  their  structural  knowledge 
for  two  interconnected  reasons.  First,  this  is  a  novel  task  for  these 
students — their  instruction  has  not  been  inclined  toward  explicit, 
analytic  examination  of  arithmetic  expressions.  Second,  because  this 
is  a  novel  task,  the  students  must  use  some  understanding  of  the 
structure  of  arithmetic  expressions  as  a  guide  to  developing 
procedures. 

For  purposes  of  analysis,  the  process  of  judging  the  equivalence 
of  arithmetic  expressions  can  be  viewed  as  functionally  comparable  to 
judging  the  semantic  equivalence  of  natural-language  sentences. 
Consider  how  people  judge  the  equivalence  of 
John  gave  the  book  to  Mary  to  Mary  was  given  the  book  by  John.  A 
simple  model  of  this  process  holds  that  the  two  sentences  are  parsed 
into  meaningful  units,  and  the  units  compared  semantically  by  a 
process  that  yields  an  equivalence  judgment  CCarpenter  &  Just,  1973). 
By  analogy,  a  simple  psychological  model  of  how  a  person  might  perform 
this  arithmetic  task  is  as  follows.  First,  a  parse  is  made  of  the  two 
expressions  to  be  compared,  identifying  meaningful  units.  Then,  the 
resulting  units  are  used  as  arguments  to  a  reasoning  process  that 
decides  the  equivalence  of  two  expressions.  This  analogy  reveals  two 
psychological  processes  that  might  be  involved  in  performing  this 
task:  parsing  methods  and  judging  methods. 
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Thiaklag-aloud  protocols  collected  from  students  performing  this 
task  were  analyzed  to  Identify  the  categories  of  parsing  and  judging 
methods  used.  These  two  aspects  of  performance  are  taken  to  reflect 
students'  knowledge  about  the  structure  of  arithmetic  expressions. 
The  analysis  also  Identifies  the  range  of  methods  that  the  students 
use  and  some  functional  characteristics  of  the  use  of  these  methods, 
and  errors  that  are  made.  The  general  theme  of  these  results  Is  that 
the  students  use  several  different  parsing  and  judging  methods,  and 
that  the  parsing  or  judging  of  a  particular  expression  sometimes 
depends  on  the  expression  against  which  It  Is  compared.  Several 
errors  In  parsing  and  judging,  usually  Involving  the  subtraction 
operator,  were  Included  among  these  methods. 

We  aim  ultimately  to  specify  more  clearly  what  Is  meant  by 
"knowledge  of  structure  of  arithmetic  expressions."  We  view  the 
descriptions  of  the  methods  and  their  functional  characteristics  as  an 
Intermediate  stage  between  the  protocols  and  a  satisfactory  model,  and 
believe  these  kinds  of  descriptions  provide  us  with  a  foundation  for 
developing  a  formal  model  of  structural  knowledge.  Meanwhile,  they 
are  of  Interest  for  what  they  suggest  about  the  nature  of  students' 
structural  knowledge.  In  particular,  the  results  support  the 
hypothesis  that  students  are  able  to  reason  with  a  number  of  concepts 
needed  In  algebra,  but  are  missing  some  Important  constraints  on  this 
knowledge.  The  paper  closes  with  a  general  discussion  of  these  points 
and  some  of  their  educational  implications. 

Method 

Task  and  Materials 

The  task  was  to  judge  the  equivalence  of  three  sets  of  arithmetic 
expressions  without  computing  numerical  answers  (see  Table  1).  Each 
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expressloQ  had  three  terms  aod  an  addition  and  a  subtraction  operation 
except  for  one  expression  in  the  first  set.  Within  each  set  of 
expressions  the  same  numbers  were  \ised,  but  different  numbers  were 
used  across  sets.  The  first  set  had  four  expressions  composed  of 
small-digit  numbers.  The  second  set  had  four  expressions  composed  of 
three-digit  numbers.  The  third  set  had  five  expressions  also  composed 
of  three-digit  numbers.  When  they  were  presented  to  the  children, 
each  expression  was  written  on  a  separate  4  in.  Cl^.l^  cm)  x6  in. 
(L3.24  cm)  card. 


Insert  Table  1  about  here 


We  will  refer  to  the  seta  respectively  as  the  L2*s  set,  the  947'^a 
set,  and  the  6ki'a  set.  These  expressions  were  selected  for  the 
following  reasons.  The  L2''s  set  serves  in  part  as  a  check  that  the 
children  can  solve  at  least  some  equivalence- Judging  problems.  All 
the  numbers  are  small.  Each  expression  started  with  the  same  nimber. 
This  number  was  also  the  largest  of  the  three  terms  in  each 
expression.  The  second  L2's  expression,  in  the  list  in  Table  1,  had 
two  additions  in  contrast  to  the  other  three  that  had  one  addition  and 
one  subtraction.  This  expression  was  included  to  check  that  the 
students  had  at  least  a  minimal  ability  to  do  the  the  task.  Also,  the 
third  and  fourth  expressions  were  included  to  offer  the  possibllty  of 
inverting  subtraction.  In  this  set,  only  the  first  and  fourth 
expressions  are  equivalent. 
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The  947 's  set  had  the  largest  number  first  In  three  of  the  four 
expressions.  The  positions  of  the  addition  operator  and  the 
subtraction  operator  are  crossed  with  the  positions  of  the  last  two 
numbers.  This  yields  the  first,  second  and  fourth  expressions.  The 
third  expression  was  varied  by  switching  the  position  of  the  first  and 
last  numbers.  In  this  set,  the  first  and  fourth  expressions  are 
equivalent  as  are  the  second  and  third.  Two  special  features  were 
designed  Into  this  set.  The  first  two  expressions  In  the  947 's  set  In 
Table  1  were  Included  because  the  subexpressions  formed  with  the  635 
and  492  are  equivalent  when  considered  In  Isolatioa,  but  are  not 
equivalent  when  considered  In  Che  context  of  the  whole  expression. 
The  last  two  expressions  were  Included  because  their  terms  are  In 
reverse  order.  That  la,  one  begins  with  635,  has  492  In  the  middle, 
and  ends  with  947;  the  other  begins  with  947,  has  492  In  the  middle, 
and  ends  with  635. 

The  643 "s  set  was  designed  to  not  have  Che  same  first  numbers, 
and  by  having  five  choices,  the  subjects  could  not  try  to  second  guess 
a  symmetrical  pattern  as  In  the  947 's  set.  The  equivalent  pairs  In 
this  sec  are:  first  and  fourth,  and  second  and  fifth.  The  second  and 
fourth  expressions  are  In  reverse  order.  They  also  offer 
opportunities  to  Invert  subtraction  for  a  pair,  or  to  Insert  Implicit 
parentheses  around  the  373  and  597  and  Invert  Che  subtraction  with  the 
643. 

Subjects 

Six  children,  five  sixth-graders  and  one  eighth-grader, 
participated  In  the  study.  They  were  competent,  probably 
above-average,  prealgebra  students.  At  the  time  of  the  Interviews, 
near  the  end  of  the  school  year,  they  were  working  In  the  8th  grade 
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book  of  the  Scott-Foresman  textbook  series.  Maay  of  them  were  going 
to  enter  a  sLowiy-paced  algebra  course  in  the  following  school  year. 

As  best  we  can  tell,  judging  the  equivalence  of  arithaetic 
expressions  was  completely  novel  to  the  students.  They  reported 
informally  that  they  had  never  done  such  a  task.  Also,  we  examined 
the  textbook  series  from  which  they  were  taught.  In  general, 
mathematics  curriculum  in  America  follows  the  textbook  closely.  Any 
deviation  from  the  text  is  usually  the  omission  of  sections  and  not  a 
supplement  to  the  text  (Freeman  et  al.,  1983;  National  Advisory 
Committee  on  Mathematics,  1973).  The  curriculum  is  heavily  oriented 
to  calculating  different  expressions,  with  fractions,  decimals,  signed 
numbers,  and  with  different  operations.  We  note  that  the  students 
never  encounter  a  three-term  expression  with  addition  and  subtraction. 
The  only  mixed  operations  are  addition  and  multiplication  and  in  these 
cases  parentheses  are  always  given.  As  you  might  imagine,  the 
students  are  not  given  problems  in  which  they  are  asked  to  judge  the 
equivalence  of  two  expressions. 

Procedure 

In  individual,  audio-recorded  interviews,  the  students  were  first 
asked  "what  it  means  for  two  expressions  to  be  equivalent."  and  then 
told  that  they  would  sort  arithmetic  expressions  according  to 
equivalence.  The  12's  set  was  presented  first,  followed  by  the  947's 
set,  and  then  the  64d''s  set,  with  the  expressions  presented  in  the 
descending  order  given  in  Table  1.  To  start,  we  presented  the  first 
pair  of  expressions  in  a  set  and  asked  the  students  to  judge  the 
equivalence  of  the  pair.  They  were  told  not  to  compute,  which  they 
usually  obeyed;  and  we  generally  discouraged  numerical,  but  not 
ordinal,  estimation.  We  also  asked  them  to  explain  how  they  made 
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their  Judgneat,  and  usually  probed  to  clarify  their  answers.  No 
feedback  about  correctness  was  given.  The  two  expressions  were  placed 
together  if  they  were  Judged  equivalent,  and  separately  If  not.  After 
each  judgment,  we  presented  another  expression  to  compare  against  the 
ones  already  presented  until  all  expressions  In  the  set  were  Judged. 
I^e  then  removed  the  set,  recording  the  pairs  of  expressions  Judged 
equivalent,  and  proceeded  to  the  next  set.  The  recorded  Interviews 
were  transcribed  for  the  data  analysis. 

Results  and  Discussion 

The  major  data  analyses  reported  here  examine  the  kinds  of  parses 
the  students  made,  and  the  rules  they  used  to  Judge  equivalence  of 
expressions.  To  be  sure,  we  think  analytic  separation  of  the  parsing 
operations  from  the  equivalence- Judging  operations  may  sometimes 
distort  the  character  of  the  actual  process,  but  It  provides 
descriptive  summaries  of  Important  aspects  of  performance  that  cannot 
be  seen  readily  from  reading  Individual  protocols. 

Correctness  of  Performance 

Before  examining  parsing  and  Judging  methods,  let's  first  look  at 
the  correctness  of  the  performance.  These  data  do  not  play  a  central 
role  In  addressing  the  major  questions,  but  they  help  establish  a 
picture  of  the  difficulty  of  this  task  for  the  students.  We  scored 
whether  a  student  correctly  or  Incorrectly  Judged  the  equivalence  of  a 
pair  of  expressions.  Only  those  pairs  on  which  a  student  explicitly 
commented  were  scored;  uncommented  pairs  were  unscored.  A  summary  of 
this  analysis  for  each  subject  Is  shown  In  Table  2. 


Insert  Table  2  about  here 


Algebraic  Tasks 


Page  LL 


These  data  support  the  followlag  coaclusioas. 

L.  Equlvaleace- Judging  Is  not  an  Inposslble  task.  The  students 
produced  correct  answers  £or  the  comparisons  in  the  L2's  set. 
This  perfect  performance  is  not  a  result  of  the  students 
calculating  the  answers.  In  some  cases,  they  were  asked  whether 
they  had  calculated  and  they  claimed  no;  in  other  cases  where 
students  computed  these  expressions,  they  made  errors  in 
calculation,  supporting  the  contention  that  their  perfect 
performance  was  not  a  consequence  of  surreptitious  calculation. 

2.  On  the  other  hand,  equivalence** Judging  is  not  always  an  easy  task 
to  perform  correctly.  The  students  were  correct  only  about  half 
of  the  time  on  the  947  set  which  with  pairwise  comparisons  is 
chance-* level  performance. 

3.  The  comparisons  were  not  differentially  difficult  for  the 
students.  The  two  students  who  made  the  most  errors  with  the  947 
set  also  made  the  most  errors  on  the  648  set.  Similarly,  the  two 
students  who  were  most  correct  on  the  643  set  were  among  the  best 
on  the  947  set. 

In  sum,  these  data  indicate  that  students  can  do  this  task,  although 
not  very  well.  Of  greater  concern,  and  to  which  we  now  turn,  is 
whether  there  is  anything  systematic  or  regular  in  how  students 
generate  their  answers. 

Parsing  Performance 

The  purpose  of  this  analysis  is  to  examine  the  structure  or 
outcome  of  the  students'  parsings,  showing  the  several  kinds  of 
parsings  used  in  their  equivalence* Judging  performance.  The  students' 
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expLanacorj  scaceaeats,  given  after  they  classified  a  pair  of 
expressions  as  equivalent  or  not,  were  analyzed  to  identify  the 
parsing.  Questions  about  how  or  why  chese  parses  were  made  can  be 
considered  once  the  basic  phenomena  are  established. 

Three  general  results  are  established  here.  First,  the  same  pair 
of  expressions  can  be  parsed  in  different  ways  by  different  students. 
Apparently,  a  particular  expression  does  not  determine  a  particular 
parse.  Second,  the  same  expression,  when  compared  against  different 
expressions.  Is  sometimes  parsed  In  different  ways  by  the  same 
student.  This  suggests  that  the  parsing  of  an  expression  can  be 
context  dependent.  Third,  some  parsings  violate  the  conventional 
mathematical  Interpretation  of  these  expressions.  Specific  kinds  of 
errors  are  Indicative  of  the  absence  of  Important  constraints  In  a 
student's  understanding  of  the  structure  of  arithmetic  expressions. 
Evidence  for  these  results  Is  presented  after  a  discussion  of  the 
observed  categories  of  parses  and  the  criteria  used  to  classify  a 
protocol  as  Indicative  of  a  particular  parse  category. 

Criteria  Used  to  Identify  Parsing 

Our  analysis  of  the  parsing  performance  Is  predicated  on  the 
following  construal  of  parsing.  First,  we  distinguish  two  senses  of 
parsing.  One  sense  refers  to  the  units  of  parsing  that  the  students 
used.  The  two  major  kinds  of  parsing  units  are:  binary  and  unary. 
The  other  sense  of  parsing  refers  to  the  sequence  In  which  these  units 
are  constructed  to  relate  the  terms  of  an  expression.  These  two 
senses  correspond  to  a  phrase-structure  parsing  of  a  verbal  sentence. 
The  first  sense  corresponds  to  the  units  used  In  the  parse  tree;  the 
second  to  the  particular  relations  described  among  the  units.  In 
general  we  focus  on  the  second  sense,  but,  as  will  be  seen,  the  two 
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are  coextensive  in  soae  cases. 

We  used  four  categories  of  whole  parses  to  describe  the 
performance.  A  whole  parse  Is  one  In  which  all  the  terms  of  an 
expression  are  related  to  each  other.  One  category  Is,  called  binary. 
Includes  all  parsings  In  which  binary  parse  units  were  clearly  used. 
A  second  category,  called  unary.  Includes  all  the  Instances  In  which  a 
unary  parse  unit  was  used.  The  other  two  whole-parse  categories  are 
special  sequences  In  which  the  focus  Is  more  on  a  global  relation 
among  all  the  elements  rather  than  the  units  used.  One  Is  a 
left- to- right  parse,  the  other  Is  a  backwards  parse. 

In  addition  to  these  categories  of  whole  parses,  four  additional 
categories,  reflecting  mostly  other  parsing  units,  were  needed  to 
cover  the  observed  performance.  The  need  arose  because  sometimes 
students'  protocols  did  not  provide  sufficient  Indication  that  they 
had  examined  and  related  all  the  terms  of  an  expression.  And  In  some 
cases.  It  seemed  pretty  clear  that  they  had  not. 

The  unit  of  the  binary  parse  Is  a  pair  of  terms  connected  by  an 
operator.  Thus,  In  a  three- term  expression  there  are  three  sequences 
In  which  whole  binary  parses  can  be  constructed,  though  they  do  not 
always  preserve  equivalence.  In  the  following  example  they  do.  In 
the  expression  a  b  -  c.  the  binary  parses  are:  Ca)  a  b  emd  then 
q  -  c.  where  ^  Is  the  first  binary  pair;  (b)  b  -  c  and  then  a  •>•  q. 
where  £  Is  the  first  binary  pair;  and  (c)  a  -  c  wd  then  q  b.  where 
£  Is  the  first  binary  pair. 
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AltliQugh  there  are  these  different  sequences  in  which  binary 
units  can  be  used  to  parse  a  three-term  expression,  we  used  a  single 
category  for  all  of  these  cases.  It  will  be  easier  to  explain  why  we 
do  not  differentiate  the  parsings  in  this  category  after  we  have 
discussed  specific  student  performances.  This  discussion  can  be  found 
in  the  section  titled  Across- set  Parsing  Performance. 

Protocols  statements  were  classified  as  evidence  for  binary 
parsing  when  students  talked  explicitly  about  Intermediate  results  and 
used  words  such  as  then  to  talk  about  the  next  step.  Here  are  two 
protocols  that  were  classified  as  binary.  They  are  meant  to  give  a 
sense  of  the  sort  of  protocol  classified  as  binary.  In  the  first 
protocol,  Stella  was  comparing  the  expression  947  f  492  -  685  with  the 
expression  685  -  492  947.  She  says: 

Case  947  492  -  685  685  -  492  947 

947  -t*  492  would  be  these  two  together  and  then  you  subtract  the 
685. 

It  appears  that  she  is  taking  947  -t-  492  to  be  one  binary  unit,  and 
then  the  result  of  that  operation  as  part  of  a  second  binary  unit  with 
the  685.  In  the  second  protocol,  Rudolf  is  comparing  648  373  -  597 
and  873  +■  597  -  548.  He  says: 

Case  2:  648  +  873  -  597  873  +  597  -  648 

Because  this  [648]  and  this  [873]  adds  up  to  more  than  on  the 
first  one  [873  4-  597].  And  then  you'd  subtract  579  [sic] ,  which 
is  less  than  648. 

It  appears  that  he  is  taking  the  additive  pair  as  one  binary  unit,  and 
then  composing  the  outcome  of  this  operation  with  the  last  term  of  the 
expression  to  form  a  second  binary  unit. 
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The  ualt  of  the  unary  parse  consists  of  a  operator->nuaber  pair. 
That  is,  the  unary  parse  unit  treats  the  operators  in  an  expression  as 
a  function  that  requires  one  argument  (Weaver,  1982).  By  contrast, 
the  binary  parse  unit  treats  the  operators  as  function  that  requires 
two  arguments. 

The  sequence  of  the  unary  parse  is  a  termrby-term  segmenting  of 
the  expression.  This  kind  of  parsing  is  common  in  algebra.  There  are 
two  senses  of  unary  parsing  we  want  to  distinguish  here.  The 
distinction  hinges  on  the  interpretation  of  the  first  number  of  an 
expression.  On  one  view,  the  first  number  is  treated  as  a  starting 
quantity.  Other  quantities  are  added  to  or  subtracted  from  this 
starting  quantity.  On  another  view,  there  is  no  starting  quantity  and 
any  of  the  terms  of  an  expression  can  be  combined.  Both  of  these 
interpretations  are  unary  parses  because  the  psychological  units  are 
an  operator  and  a  number.  Gtowever,  the  first  interpretation  Imposes  a 
greater  constraint  on  the  operations  performed  on  the  expression. 

Protocol  statements  were  classified  as  unary  parsing  when 
students  were  comparing  expressions  by  operator-number  pairs , 
regardless  of  the  order  of  their  occurrence  in  the  expression.  This 
interpretation  was  buttressed  by  statements  in  which  Just  the  numbers 
were  compared,  and  by  statements  of  irrelevance  of  order.  Here  are 
two  examples  of  protocols  that  were  classified  as  unary  parsing.  They 
come  from  different  students  comparing  the  two  expressions  12  -  2  6 
and  12  >  6  -  2.  Joanie  said: 

Case  3:  12  -  2  6  12  +  6-2 

Well,  you  have  the  same  numbers  in  the  problem  and  you  have  the 
same  signs.  And  you  switch  them  around. 
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This  studeac  seeas  to  have  cooipared  the  aumbers  and  the  signs 
separately,  and  then  notes  that  another  order  can  be  selected.  Mary 
said: 

Case  4:  12-2+6  12+6-2 

You're  taking  away  the  sane  amount  and  you're  adding  the  same 

amount.  It's  just  a  different  order. 

This  protocol  Is  classified  as  unary  because  the  student  Is  comparing 
amounts  that  are  being  taken  away  and  added,  and  notes  the  Irrelevance 
of  the  order  In  which  this  occurs. 

In  some  protocols,  students  obviously  made  whole  parses  Cl*n., 
they  compared  all  the  elements  of  the  two  expressions) ,  but  It  Is  not 
possible  to  clearly  distinguish  whether  a  binary  or  unary  parse  was 
used.  What  seemed  to  predominate  In  these  cases  was  the  sequence  used 
to  parse  and  not  the  units  that  were  used.  In  one  such  case,  the 
special  feature  of  the  performance  was  that  parsing  proceeded  from 
left-to-rlght,  a  common  order  In  parsing  arithmetic  expressions. 
These  cases  were  coded  as  left-to-rlght  parsing.  In  this  judging 
task,  left-to-rlght  binary  and  unary  parses  are  functionally 
equivalent.  Whether  an  expression  Is  viewed  as  two  binary  steps,  or 
as  a  string  of  unary  operations,  the  same  numbers  would  be  added  and 
subtracted  In  the  same  order  If  they  were  processed  from 
left-to-rlght.  To  Illustrate  this  point,  consider  the  following 
example  in  which  a  student  compared  947  -  685  +  492  with 
947  -  492  +  685.  If  a  left-to-rlght  binary  parse  were  used,  then  the 
expression  would  be  parsed  as  follows: 


947  -  585  +  492 
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If  it  were  parsed  with  le£t-to-right  uaary  parse,  then  it  would  be 
parsed  in  this  way: 

I  947  I  I  -  685  I  1  -t-  492  I 

if  a  person  were  to  compute  these  expressions,  proceeding  from 
left- to- right,  using  either  parse,  then  the  same  outcome  would  be 
obtained.  Rather  than  forcing  a  binary  or  unary  interpretation  on  a 
protocol  when  there  is  not  clear  evidence  for  either,  this  third 
category  was  created.  Cases  are  classified  as  left-to-right  parses 
only  when  (a)  they  cannot  be  clearly  assigned  to  a  binary  or  unary 
parse  and  (b)  the  subject  refers  to  the  terms  in  the  expression  in 
left-to-right  order. 

Here  is  an  example  of  a  protocol  that  was  classified  as  a 
left-to-right  parse.  Mary  was  comparing  the  two  expressions  Just 
mentioned.  The  protocol  started  with  the  student  Judging  them 
equivalent  and  then  offering  the  following  explanation: 

Case  5^:  947  -  685  +  492  947  -  492  ¥  685 

S:  Because  in  the  first  one,  you're  talcing  away  more,  but  then 

you  add  the  same  amount  you're  talcing  away  in  the  second  one. 

E:  Here 

S:  You  talce  away... 

E:  685 

S:  ...685  and  you  add  492  in  the  first  one. 

E:  Yeah. 

S:  And  in  the  second  one  you  talce  away  492  and  add  685. 

This  protocol  could  be  interpreted  either  as  a  binary  or  unary  parse. 
On  a  binary  interpretation,  she  first  says  that  you  take  away  more, 

thus  treating  947  -  685  and  947  -  492  as  binary  units.  She  then  says 


that  you  add  the  same  amount  you  are  taking  away.  The  statement  "but 


outcoae  of  perforalog  the  subtraction  operation,  and  has  it  serve  as 
another  binary  unit  with  the  492.  Siniiariy,  in  her  iater  stateaents 
in  which  she  describes  the  sequence  of  operations,  one  could  impose  a 
binary  interpretation.  On  a  unary  interpretation,  her  initial 
description  siaply  treats  each  of  the  terms  as  a  unit  and  she 
discusses  which  units  are  being  added  and  subtracted.  Ihe  protocol 
does  not  provide  strong  evidence  for  either  interpretation.  What  does 
seem  stable,  is  that  she  is  interpreting  the  expressions  in  a 
left-to-right  manner. 

The  backwards  parse  Involves  interpreting  an  expression  from 
rig ht-to- left.  Sometimes  the  operators  are  read  right  to  left,  but 
need  not  be.  For  example,  in  comparing  947  492  ~  635  and 
685  -  492  ¥  947.  Mary  said: 

Case  6:  947  +  492  -  635  685  -  492  +  947 

rhey're  just  backwards.  Well  see,  it  starts  out  with  947  and  you 
add  492  and  you  subtract  685,  and  then  in  [the  other]  you  start 
out  with  685,  subtract  492,  and  you  add  947.  They're  just 
opposite. 

Mary  has  noticed  that  the  order  of  the  terms  in  one  expression  are 
opposite  from  the  order  of  the  terms  in  the  other  expression.  She  has 
used  a  left-to-right  parse  with  the  first  expression  and  a  backwards 
parse  with  the  second  expression.  Such  cases  were  classified  as  a 
backwards  parse. 

In  addition  to  the  four  whole~parse  categories  just  discussed, 
there  were  four  categories  of  partial  parses.  These  categories  were 
created  because  in  some  cases  it  is  difficult  to  decide  whether  a 
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sCudeat  is  parsing  the  whole  expression.  For  some  expressions,  the 
students  gave  justifications  that  did  not  mention  all  the  terms  In  the 
expression.  In  these  cases,  there  Is  not  explicit  evidence  to  tell 
whether  the  students  were  applying  a  whole-expression  parse  as 
discussed  above  or  quitting  after  comparing  some  portion  of  the  pair 
of  expressions. 

One  category  Involved  another  parsing  unit:  the  operator. 
Protocols  were  classified  Into  this  category  when  the  student  only 
mentioned  the  operators  In  the  pair  of  expressions.  For  example.  In 
comparing  12  -  2  -h  6  with  12  2  -*■  6.  a  student  might  simply  note  that 
the  operators  are  different.  A  second  category  was  an  examination  of 
a  first  binary  pair  In  an  expression.  For  example,  the  students  might 
simply  discuss  the  first  binary  pair  In  the  preceding  pair  of  12's 
expressions.  The  third  category  covers  one  subject  who  mentioned  only 
a  term  that  was  subtracted.  This  may  be  either  a  binary  or  a  unary 
unit.  The  fourth  category  also  Involves  another  parse  unit:  the 
first  number  of  a  pair  of  expressions.  This  category  covers  one 
subject  who  only  mentioned  this  unit  In  some  protocols. 

In  some  of  these  partial  cases,  subjects  may  have  parsed  the 
entire  expression  and  only  reported  the  critical  portion  that 
triggered  their  judgment.  In  these  cases,  with  a  plausible  conjecture 
that  the  students  are  noting  the  equality  of  Identical  portions  of  two 
expressions,  one  can  see  that  at  least  a  left-to-rlght  parse  was  made. 
For  example.  In  the  pair  of  12's  expressions  the  students  may  have 
noted  that  6^  was  added  In  both  expressions  and  so  limited  their 
comments  to  the  point  of  difference.  In  other  cases,  such  as  the 
first-number  category.  It  seems  pretty  clear  that  the  students  only 
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examined  a  portion  of  an  expression  to  decide  whether  a  pair  was 
eqalvalent . 

Wlthln-Set  Parsing  Performance 

Using  the  parsing  categories  just  discussed,  we  attempted  to 
determine  the  parsing  of  each  pair  of  expressions  that  students 
compared.  Table  3  contains  the  frequency  of  occurrence  of  the 
different  parsings  for  the  three  problem  sets. 

Insert  Table  3  about  here 

As  might  be  expected,  the  majority  of  the  parsings  were  classified  as 
binary.  However,  there  were  also  a  number  of  other  hinds  of  parsings. 
The  frequencies  probably  reflect  to  some  extent  the  particular 
structural  characteristics  of  the  selected  expressions.  Certain 

trends  In  the  frequencies  are  discussed  In  the  next  section. 

Protocols  from  each  of  the  three  problem  sets  will  be  discussed 
In  turn  to  Illustrate  the  three  general  results  about  parsing 
mentioned  above.  A  large  number  of  examples  are  given  for  three 

reasons.  First,  because  a  major  purpose  of  the  analysis  Is  to 

establish  the  different  parsing  methods  that  students  used,  we  want  to 
show  the  protocols  used  to  develop  the  parsing  categories.  Second, 
many  of  these  examples  are  also  discussed  as  judging  performance. 
Third,  examples  of  the  three  parsing  results  from  the  three  problem 
sets  establish  that  the  results  are  not  problem-set  specific. 

Parsing  of  the  12* s  set.  In  the  I2's  set  there  were  six  possible 
pairs  to  be  compared;  with  six  subjects,  there  are  36  possible 

comparisons.  The  subjects  provided  explicit  justifications  of  their 
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answers  on  L9  pairs.  The  breakdown  of  these  categories  are  shown  in 
Table  3.  There  are  not  a  reaarkabie  number  of  differences  in  how  the 
students  parsed  the  expressions  in  the  12's  set.  Parsing  performance 
on  this  set  of  expressions  Is  of  greater  interest  when  it  is 
contrasted  later  In  the  discussion  with  performance  on  the  other  two 
sets. 

To  Illustrate  the  first  result  about  different  parsings  for  the 
same  pair  of  expressions  by  different  students,  compare  the 
performance  of  Rudolf  and  Stella  when  they  compared  the  expressions 
12  -  2  6  and  12  -h  6  -  2.  Rudolf's  protocol  gives  evidence  for  a 

unary  parse,  while  Stella  seems  to  use  a  binary  parse.  Eludolf  said: 

Case  7_:  12-2+6  12+6-2 

It  doesn't  matter  whether  you  minus  2  before  or  after  you  add  up 

12  and  6 .  Because  it  doesn't  matter  whether  the  6,  It 

doesn't  matter  if  you  subtract  the  2  before  or  after  the  6. 

It  seems  that  Rudolf  Is  Interpreting  each  of  the  numbers  as  a  separate 
quantity  to  be  added  or  subtracted  from  12.  This  parse  is  shown 
graphically  In  Figure  1. 


Insert  Figure  1  about  here 


By  contrast,  Stella's  protocol  was: 

Case  12-2+6  12+6-2 

It's  Just  mixed  up  because  It's  still  12  +  6  as  It  Is  here,  and 
then  take  away  2. 

In  this  case,  Stella  seems  to  have  taken  12+6  as  a  unit,  and 
compared  It  with  the  other  expression,  and  then  considered  the 
remaining  number  as  a  pair  with  the  12  +  6  unit.  Her  parse  Is  shown 
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graphically  In  Figure  L.  These  protocols  illustrate  the  point  that 
the  sane  pair  of  expressions  can  be  parsed  in  a  different  manner  in 
the  course  of  judging  their  equivalence. 

There  were  no  clear  cases  of  different  parses  for  the  same 
expression  or  mathematically  incorrect  parses  in  this  set.  All  of  the 
partial  operators  that  appeared  here  seem  to  be  cases  in  which  the 
student  simply  reported  the  point  of  difference  between  two 
expressions.  Each  of  the  cases  could  have  been  reinterpreted  as  a 
binary  or  left-to-right  parse  if  one  assumes  the  equivalence  of  the 
reflexive  portions  were  judged.  For  example,  in  comparing  L2  -  2  6 
with  12  2  6.  a  couple  of  subjects  simply  noted  that  the  first  pair 
was  different. 

Parsing  of  the  947'*s  set.  For  the  947‘’o  set,  there  were  36 
possible  comparisons.  The  subjects  provided  explicit  justifications 
of  their  answers  on  22  pairs.  The  breakdown  of  the  different  kinds  of 
parsings  are  shown  in  Table  3.  The  total  equals  23  because  one 
student  used  two  different  parses  for  one  pair. 

Two  examples  illustrate  the  first  result  about  different  parses. 
In  the  first  example,  Eudolf  compared  947  -  685  •>•  492  with 
947  ~  492  685.  He  declared  they  were  equivalent  and  explained: 

Case  9^:  947  -  685  +  492  947  -  492  +  685 

Because  it  doesn't  matter  if  it's  492  or  685  here,  as  long  as 
it's  minus  947.  And  as  long  as  it's  plus  there.  ...  It  doesn't 
matter  that  these  two  are  switched  around.  [E:  The  685  and  the 
492?]  Yeah,  as  long  as  the  minus  is  right  there,  and  the  plus  is 
in  between  those  two. 

Rudolf's  explanation  suggests  that  he  made  a  binary  parsing  of  the  two 
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expressloas.  This  parsing  is  shown  in  Figure  2.  By  contrast,  Joanle 
seems  to  use  a  le£t-to-rlght  parse.  She  explains  that  they  are 
equivalent  as  follows: 

Case  1^:  947  -  685  +  492  947  -  492  +  685 

Because  on  this  one  you  subtract  685  but  you  add  492  back.  And 
on  this  one  you  subtract  492  but  you  add  685  back. 

Indeed,  whether  Joanie  is  using  a  binary  or  unary  parse,  it  is 
distinctly  different  from  Rudolf's  parse  for  the  same  pair  of 
expressions.  Joanie's  parse  is  also  shown  in  Figure  2. 


Insert  Figure  2  about  here 

In  the  second  example,  Mary  and  Stella  were  comparing  the 
expressions  685  ~~  492  +  947  and  947  4*  492  ~  635.  Using  a  binary 
parse,  Stella  judged  this  pair  to  be  equivalent.  Rer  protocol  is 
repeated  from  Case  1. 

Case  685  -  492  -I-  947  947  +  492  -  685 

Because  it's  just  reversed,  947  4-  492  would  be  these  two  together 
and  then  you  subtract  685. 

This  parse  is  shown  in  Figure  3. 

Insert  Figure  3  about  here 

Mary  also  judged  that  these  two  expressions  were  equivalent,  but  she 
used  a  right- to- left  or  backwards  parse.  Her  explanation  from  Case  6 
is  repeated.  The  parse  is  shown  in  Figure  3. 

Case  6;  685  -  492  +  947  947  +  492  -  685 

[They]  are  the  same,  they're  just  backwards.  [S:  I'm  sorry. 
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what's  backwards?]  Well  see,  it  starts  out  with  947  aad  you  add 
492  and  you  subtract  685,  and  then  In  [the  other]  you  start  out 
with  685,  subtract  492,  and  you  add  947.  They're  just  opposite. 

Two  examples  are  presented  to  Illustrate  the  second  result  that 
the  same  expression  can  be  given  a  different  parsing  by  the  same 
person  when  compared  with  different  expressions.  In  first  example, 
Nick  was  comparing  947  -  685  ->■  492  with  947  -  492  585  and  with 
947  -h  492  -  685.  Nick's  judged  the  first  pair  to  be  equivalent.  His 
protocol  was: 

Case  JA:  947  -  685  +  492  947  -  492  +  685 

They  just  rearranged  the  numbers.  [E:  Which  numbers?]  685  and 
492. 

It  appears  that  Nick  has  used  a  binary  parse  on  these  two  expressions. 
It  Is  comparable  to  the  parse  shown  for  Rudolf  In  Figure  2.  Nick 
judged  the  second  pair  to  be  equivalent  as  well.  However,  his  parsing 
of  the  first  expression  now  changes.  His  protocol  was: 

Case  12;  947  -  685  492  947  +  492  -  685 

Because  you're  subtracting  685 .  It'd  just  be  the  same  as 

doing  these  two  [947  4-  492]  and  subtracting  all  that  [685]. 

[E:  The  same  as,  9-]  This  plus  that...  [E:  +  492]  ...minus  685. 
The  parse  Is  shown  In  Figure  4.  Nick  seems  to  have  given  a 

left-to-right  binary  parse  of  947  492  -  685.  He  then  uses  the 

resulting  parse  as  a  template  against  which  to  compare  the 
947  -  685  4-  492.  He  notes  there  Is  a  947  and  a  4-  492.  which  he  takes 

as  a  comparable  binary  unit,  and  then  subtracts  that  by  685. 


Insert  Figure  4  about  here 
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la  the  second  example,  Stella  compared  the  same  first  pair  as 
Nlch  and  parsed  it  the  same  way  as  Rudolf  and  Nick  (see  Cases  9  and  11 
and  Figure  3).  She  then  went  on  to  compare  947  -  685  492  with 
685  -  492  -t-  947.  Now  she  uses  a  binary  parse  on  the  two  expressions 
with  a  left-to-right  sequence.  She  judged  the  two  expressions  to  be 
not  equivalent  and  explained: 

Case  947  -  685  +  492  685  -  492  +  947 

Because  947  plus  the  remainder  of  that  [685  -  492]  would  probably 
be  more  than  947  take  away  685,  plus  the  remainder  of  that  [492 
added  to  the  result  of  947  -  685]. 

She  discusses  the  second  expression  first,  saying  that  if  you  added 
947  to  the  result  of  685  ~  492.  that  it  would  be  more  than  947  -  685. 
then  adding  in  the  remaining  492.  Ber  parsing  is  shown  in  Figure  5. 


Insert  Figure  5  about  here 


These  two  examples  show  that  the  same  expression  can  be  parsed  in  a 
different  way  according  to  the  expression  against  which  it  is 
compared . 

Concerning  the  third  result,  there  are  a  number  of  parsings  in 
the  947  set  that  violate  mathematical  conventions.  Some  have  already 
been  presented.  The  parsing  that  Stella,  Rudolf,  and  Nick  made  of 
947  -  685  492  and  947  -  492  685  was  one  such  error  (see  Cases  9 
and  11).  For  purposes  of  labeling,  we  call  it  the  "binary 
error."  The  error  is  that  the  students  made  an  additive  pair  a  unit 
and  applied  the  minus  operator  to  the  sum  of  the  additive  pair,  rather 
than  the  first  term  of  the  pair. 
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The  other  notable  error  was  the  right-to-left  or  backwards  parse. 
Two  of  the  six  subjects  noted  that  635  -  492  +  947  and  947  f  492  -  685 
were  equivalent  because  they  were  just  backwards.  One  student,  Mary 
(Case  6),  proceeded  to  read  both  expressions  with  the  proper  signs. 
Exact  Interpretation  Is  not  possible,  but  she  does  not  seem  highly 
concerned  about  what  numbers  the  operators  are  assigned  to.  The  other 
subject  who  made  this  mistake,  on  this  and  other  pairs  was  more 

explicit.  He  discussed  how  one  could  read  an  expression  In  either 

direction  and  that  the  sign  preceding  the  number  (depending  on  which 
direction  one  was  going)  would  be  assigned  to  the  number. 

There  Is  one  partial  parse  worth  noting.  Joanle  was  concerned 
about  the  number  that  the  expressions  started  with.  In  the  12's  set, 
all  the  expressions  started  with  the  same  number.  In  this  set,  one  of 
the  expressions  does  not  start  with  the  same  number.  She  first  judged 

947  -  685  492  and  947  -  492  685  to  be  equivalent  (see  Case  10). 

She  then  encountered  685  -  492  947.  She  said: 

Case  IM  685  -  492  +  947  947  -  685  +  492  947  -  492  685 

That  goes  In  a  separate  pile  because  the  number  you  start  out 
with  Is  lower  than  In  this  pile. 

Later  when  she  was  discussing  how  she  did  this  set  of  expressions,  she 
said,  "See  If,  It  depended  on  where  the  signs  were  with  the  numbers. 
But  the  first  number  always  had  to  be  the  same.  Because  that's  the 
starting  element." 

Parsing  of  648' s  set.  For  the  648's  set,  there  are  10  possible 
pairs  of  expressions  to  compare.  One  of  the  subjects'  statements  was 
unlnterpretable  with  respect  to  the  parsing  he  used,  so  the  data  from 
only  five  subjects  were  examined,  making  a  total  of  50  possible 


Algebraic  Tastes 


Page  27 


respoases.  There  were  33  interpretable  responses  for  explicitly 
compared  pairs.  The  breakdown  of  the  parsing  is  shown  in  Table  3. 

Two  examples  are  given  to  illustrate  the  first  result  that  the 
same  pair  of  expressions  are  parsed  differently  by  different  students. 
In  the  first  example,  students  were  comparing  648  373  ~  597  with 
873  597  ~  648.  Stella  used  a  binary  parse  on  this  pair.  She 
decided  that  this  pair  was  equivalent  and  explained: 

Case  648  +  873  -  597  373  597  -  648 

If  you  added  873  4*  597,  you  would  get  a  smaller  number  than  643 
take  away  [ aid  700,  or  873.  And  then  you  take  away  a  larger 
number  and  then  a  smaller  number. 

The  parse  for  this  expression  is  shown  in  Figure  6.  It  seems  that 
Stella  was  examining  the  the  first  binary  pair  and  then  considering 
that  pair  as  a  unit  with  the  last  number  in  the  expression. 


Insert  Figure  6  about  here 


By  contrast,  Joanie  also  judged  the  same  pair  of  expressions  to  be 
equivalent,  but  she  used  a  left-to-right  parse  that  seems  closer  to 
unary  than  binary.  Her  protocol  was: 

Case  \^.  648  +  873  -  597  873  +  597  -  648 

You  added  this,  the  highest  number  plus  the  lowest  number,  and 
you  subtracted  the  middle  number.  In  this  you  added  the  highest 
number,  the  middle  number  plus  the  highest  number  and  subtracted 
the  lowest  number. 


It  seems  that  Joanie  is  considering  the  number  in  a  left- to- right 
manner,  but  she  takes  the  whole  expression  and  their  interrelations  in 
her  parsing  rather  than  two  binary  units  as  we  find  in  Stella's 
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protocol*  The  structure  of  Joaaie's  parse  is  shown  in  Figure  6. 

In  the  second  example,  we  want  to  show  three  different  ways  that 
students  parsed  the  expressions  873  597  -  648  and  648  ~  597  ¥  873. 
These  were  the  only  three  observations  obtained  on  this  pair, 
reinforcing  the  point  that  different  students  sometimes  make  different 
parses  on  the  same  pair  of  expressions.  In  the  first  case,  Nick  used 
a  lef t'to-right  parse  in  examining  the  two  expressions.  He  first 
claimed  that  the  two  expressions  were  different,  describing  the  latter 
as: 

Case  Uj  873  +  597  -  648  648  -  597  873 

Because  you're  subtracting  these  two  and  adding  this  and  it  would 
come  out  to  arotmd . . . [ E :  Subtracting  which  two?]  These  two  [E: 
The  648  and  597?]  feah.  And  you're  adding  873.  So  it  would 
come  out  to  be...  1  want  to  check  this. 

Nick  proceeded  to  estimate  the  values  of  the  two  expressions  and 
subsequently  decided  that  they  were  about  the  same.  This 
left-to~rlght  approach  is  not  exactly  driven  by  an  analytic  approach 
to  comparing  this  pair  of  expressions,  but  it  provides  a  contrast  to 
the  other  two  approaches  that  were  observed.  Rudolf  approached  this 
set  of  expressions  with  a  binary  parse.  He  decided  that  these  two 
expressions  were  not  equivalent  and  explained  as  follows: 

Case  18.:  873  +  597  -  648  648  -  597  +  873 

Because  these  two  [873  +  597]  added  up  are  always  higher  than 
this  [648].  So  they  wouldn't  be  negative  numbers.  But  these  two 
[597  873]  added  up  and  then  subtracted  from  this  [643]  would  be 
a  higher  negative  number.  Because  these  two  are  higher  than 
this.  And  if  you  subtract  them  from  that.... 

Rudolf's  parse,  shown  in  Figure  7,  shows  how  he  made  binary  pairs  with 
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the  addition  operators  and  then  coaposed  the  result  Into  a  binary  pair 
with  the  subtraction  operator.  Mary  Judged  this  pair  of  expressions 
to  be  equivalent.  Her  parse  was  a  backwards  parse,  shown  In  Figure  7. 
in  her  protocol  she  refers  to  the  two  expressions  by  labeling  nunbers 
that  were  on  the  cards  with  the  expressions.  The  protocol  went: 

Case  ^9:  873  +  597  -  648  648  -  597  +  873 

Because  It  starts  out  In  two  It  goes  873  +  597  -  648,  In  four 
It's  648  -  597  +  873.  It's  just  the  rev-,  they're  backwards,  and 
It  would  be  the  saae. 


Insert  Figure  7  about  here 


Two  examples  are  given  to  Illustrate  the  second  result  that  the 
parsing  of  a  particular  expression  Is  affected  by  the  expression 
against  which  It  Is  being  coapared.  In  the  first  example,  Nick  Is 
comparing  597  -  648  -»•  873  with  648  >  873  -  597  and  648  -  597  873. 

Nick  judged  the  first  pair  to  be  equlvcdent  to  each  other,  explaining: 

Case  597  -  648  +  873  648  +  873  -  597 

You  can  just  add  these  two  and  subtract  597. 

Here  It  seems  that  Nick  has  made  a  binary  parse  with  the  two  additive 
pairs,  and  then  made  another  binary  pair  with  the  subtractions.  This 
parse  la  shown  In  Figure  8.  For  the  second  pair,  which  Nick  judged 
Immediately  after  the  first  pair,  he  said  they  were  equivalent  and 
explained : 

Case  597  -  648  +  873  648  -  597  +  873 

Because  this  number  648,  it's  just  being  changed  around  as  far  as 
I  understood  It. 


We  take  this  to  mean  that  Nick  Is  Inverting  the  first  pair  of  numbers 
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In  597  -  648  +  873,  thus  asking  it  identical  to  648  ~  597  4-  873.  The 
parse  for  this  expression  is  shown  in  Figure  8  as  well.  One  can  see 
that  the  parse  aade  on  597  -  648  873  has  changed  depending  on  which 
expression  it  was  being  coapared  with. 


Insert  Figure  8  about  here 


In  the  second  exaaple,  Joanie  was  coaparing  648  873  -  597 , 

873  >  597  -  648.  and  597  4-  648  -  873.  In  coaparing  the  first  pair, 
which  she  Judged  equivalent,  she  used  a  left*'tO'*right  parse  in  which 
she  coapared  the  three  numbers  at  once.  Her  protocol,  given  in  Case 
L6,  is  repeated  here. 

Case  648  +  873  -  597  873  +  597  -  648 

You  added  this,  the  highest  nuaber  plus  the  lowest  number,  and 
you  subtracted  the  middle  nuaber.  In  this  you  added  the  highest 
nuaber,  the  middle  nuaber  plus  the  highest  nuaber  and  subtracted 
the  lowest  nuaber. 

In  coaparing  these  two  expressions  she  is  coordinating  the  relations 
between  the  three  numbers,  noting  which  numbers  were  being  added  and 
subtracted.  She  did  a  similar  coaparison  of  magnitudes  in  coaparing 
the  first  two  expressions  with  the  third  expression.  But  now  there  is 
a  distinctly  binary  parse.  She  says  that  the  third  expression  is  not 
equivalent: 

Case  2^.  597  +  648  -  873 

Because  this  makes  a  smaller  nuaber.  [E:  The  first  t%K> 

terms?]  Yeah.  And  then  you  subtract  a  greater  nuaber. 

She  is  no  longer  coordinating  the  three  numbers  in  one  structure, 
instead  focusing  on  the  first  pair  and  then  using  that  as  a  unit  to 
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coapose  Into  another  binary  pair  with  the  last  digit. 

Concerning  the  third  result,  the  same  errors  we  observed  for  the 
947  set  were  edso  observed  for  the  648  set.  In  particular,  there  were 
a  nuaber  of  cases  in  which  the  students  formed  binary  pairs  with  the 
additive  pair  and  subtracted  the  sum  from  the  first  number  in  the 
expression.  There  was  also  an  Instance  of  the  bac1c»ard  parse.  In 
addition,  we  observed  cases  in  which  the  students  were  inverting  a 
binary  subtraction  pair.  This  occurred  both  for  a  single  binary  pair 
and  for  a  binary  pair  composed  of  an  additive  pair  and  a  subtraction. 
Examples  were  shown  above  in  Nick's  protocol  (see  Figure  3). 

A  final  note  about  a  partial  parsing  that  occurred  in  this  set  of 
expressions.  When  Joanie  encountered  597  -  648  873  she  said,  "This 
is  impossible.  You  can't  subtract  648  from  597  unless  you're  using 
negatives  and  positives."  This  case  shows  that  sometimes  students  do 
not  need  to  parse  all  the  terms  of  an  expression  to  decide  on  its 
equivalence. 

Across-Set  Parsing  Performance 

This  section  discusses  some  of  the  general  characteristics  of  the 
parsing  across  the  three  sets  of  expressions.  These  characteristics 
are  taken  to  be  primarily  a  consequence  of  the  structure  of  the 
expressions,  rather  than  some  general  parsing  capability  of  the 
students.  The  problem  sets  were  not  designed  to  provide  a 
comprehensive  coverage  of  the  kinds  of  expressions  that  one  might 
encounter,  so  it  is  not  reasonable  to  draw  any  conclusions  about  the 
frequency  of  different  kinds  of  parses.  However,  there  are  two 
notable  trends  in  the  parses  observed  when  comparisons  are  made  across 
the  three  problem  sets. 
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First,  there  were  different  distributions  of  parses  across  the 
three  problai  sets.  These  differential  distributions  are  supportive 
of  the  point  that  content  of  the  expressions  can  affect  the  kinds  of 
parses  that  one  observes.  On  the  L2's  set  there  was  a  greater 
occurrence  of  unary  parses,  and  there  were  comments  about  the 
subtraction  operator  that  we  did  not  see  in  the  other  two  sets.  We 
suspect  that  the  unary  parses  on  the  L2's  set  may  be  a  function  of  (a) 
numbers  that  are  sufficiently  small  to  enable  the  students  to  fora  a 
conceptual  structure  relating  the  effect  of  adding  and  subtracting 
each  number  to  the  value  of  the  expression,  and  (b)  expressions 
beginning  with  the  same  number,  which  was  also  the  largest,  so  that  it 
was  possible  to  simply  evaluate  the  effects  of  adding  and  subtracting 
the  other  two  numbers  to  the  first  number.  This  does  not  mitigate  the 
fact  that  the  students  were  doing  a  unary  parse.  It  Just  raises  a 
possible  boundary  condition  on  the  generality  of  their  unary  parsing 
abilities.  For  the  947  set,  no  unary  parses  were  observed  and  there 
was  roughly  an  even  split  between  clear  binary  and  non^blnary  cases. 
For  the  648  set,  the  majority  of  parses  were  binary. 

When  one  examines  the  sequences  in  which  binary  parses  were 
conducted,  then  it  is  apparent  that  there  is  no  predominating  bias. 
This  point  is  important  to  notice  because  the  cases  presented  above 
are  consistent  with  an  induction  that  says  subjects  prefer  to  form 
their  first  binary  unit  with  the  plus  sign.  In  fact,  most  of  these 
binary  parses  seem  to  follow  from  a  number  of  different  structural 
features  of  the  expressions,  rather  than  a  strategic  preference  of  the 
subjects.  Of  the  11  binary  parses  observed  for  the  947's  set,  4  of 
them  followed  a  left^to-right  sequence  on  expressions  that  also 
happened  to  have  a  minus  sign  as  the  first  binary  unit.  Five  formed 
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the  first  blaary  unit  with  the  plus  sign,  without  following  a 
lef t-to-rlght  sequence:  but  these  pairs  also  had  the  same  au!Bber3» 

hence  a  likely  unit  for  students  to  fora.  Only  2  of  the  LL  binary 
parses  formed  the  blaary  unit  with  the  plus  sign  first,  with  both 
nuabers  not  the  same,  and  did  not  follow  a  left-to-  right  sequence. 
Comparable  results  were  obtained  for  the  648's  set.  Of  the  22  blaary 
parses,  8  of  them  followed  a  left- to- right  sequence  In  which  the  plus 
sign  happened  to  be  first  la  the  expression.  Three  followed  a 
left-to-rlght  sequence  In  which  the  first  binary  unit  was  addition  In 
one  expression  and  subtraction  In  the  other.  Four  formed  the  first 
binary  unit  with  the  plus  sign,  but  these  pairs  also  had  the  same  two 
numbers.  Six  formed  the  binary  unit  with  the  plus  sign  first,  with 
both  numbers  not  the  same,  and  did  not  follow  a  left-to-rlght 

sequence,  and  L  formed  the  binary  unit  with  the  minus  sign  first  and 

did  not  follow  a  left-to-rlght  sequence. 

Second,  there  appears  to  be  some  weak  treads  regarding  the 
parsing  used  by  Individual  students  across  the  set  of  expressions. 
Mary,  Joanle,  and  Nick  seemed  to  follow  a  more  left-to-rlght  and  unary 
approach.  Stella  and  Rudolf  seemed  more  oriented  to  blaary  parses. 
Only  Stella  seemed  to  consistently  follow  a  single  kind  of  parsing, 
the  other  students  usually  had  a  mixture.  A  particularly  striking 
case  was  Rudolf  who  used  unary  parsing  for  the  12's  set,  and 
consistently  used  blaary  parsing  for  the  other  two  sets.  Moreover, 
each  of  his  blaary  parses  for  the  947 's  and  648's  formed  the  first 
binary  unit  with  the  plus  sign.  He  was  the  student  who  produced  the 

two  cases  for  the  947 's  and  the  six  cases  for  the  648's  In  which  the 

plus  sign  was  the  first  blaary  unit,  with  both  numbers  not  the  same, 
and  did  not  follow  a  left-to-rlght  sequence.  These  trends  Indicate 
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Chat  Lodivldual  sCudeats  may  be  able  to  work  with  different  kinds  of 
parses,  but  have  preferred  parses  that  they  work  from  In  evaluating  a 
set  of  expressions. 

Judging  Performance 

There  Is  a  minor  theme  and  a  major  theme  developed  In  the  results 
about  Judging  methods.  The  minor  theme  Is  that  the  students  do  not 
seem  to  have  well-developed  strategies  for  attacking  the 
equivalence-judging  task.  They  did  not  seem  to  have  algorithmic 
approaches  nor  did  It  appear  obvious  to  them  how  to  proceed.  This  Is 
not  surprising  given  that  this  Is  a  novel  task  for  them.  The  major 
theme  la  that,  despite  the  minor  theme,  they  were  able  to  develop  and 
use  a  number  of  methods.  Like  the  parsing  analysis,  the  primary 
concern  Is  to  Identify  the  existence  of  the  different  methods  with 
which  the  students  Judged  the  equivalence  of  these  expressions.  These 
methods  are  taken  to  reveal  the  student's  knowledge  of  the 
mathematical  structure  of  the  arithmetic  expressions,  and  provide 
evidence  that  the  students  may  have  the  capacity  to  work  with 
conceptual  Ideas  found  In  their  Judging  rules. 

Evidence  for  the  minor  theme  comes  from  the  fact  that  most  of  the 
students  encountered  pairs  of  expressions  for  which  they  first 
asserted  that  they  could  not  tell  whether  they  were  equivalent  or  not, 
or  produced  one  answer.  The  students  then  proceeded  to  find  a  method, 
or  switched  their  answers  after  closer  examination  of  the  pair  of 
expressions,  usually  accompanied  by  a  statement  of  "Well  wait,"  which 
Is  taken  as  a  conversational  signal  that  a  new  Idea  has  appeared. 
Here  Is  a  particularly  good  example.  Rudolf,  one  of  the  more  accurate 
students,  was  comparing  12-2+6  and  12+2+6.  He  had  determined 


analytically  that  these  two  expressions  were  not  equivalent.  However, 
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he  aeeded  Co  cootpuce  Che  answers  Co  reassure  himself  chac  his  analysis 
was  correcc.  This  example  is  an  illuscracion  of  Che  claim  chac  che 
scudencs  do  noc  have  well-developed  scraCegies  and  inCuiCions  abouC 
Che  judging  cask. 

Addicional  evidence  comes  from  some  of  Che  Judging  meChods 
discussed  below  chac  were  noced  as  possible  defaulc  meChods.  We 
presume  Chese  mechods  reflecC  che  lack  of  developed  meChods.  However, 
Che  analyses  presenCed  below  show  chaC  Che  sCudencs  have  sufficienc 
knowledge  Co  develop  a  number  of  approaches. 

The  analysis  of  Che  judging  performance  will  be  developed  in 
Chree  pares.  The  firsc  pare  discusses  Che  judging  mechods  used  for 
Che  947's  and  Che  643's.  As  pare  of  chis  discussion,  some  general 
consideracions  abouC  che  variecy  of  judging  mechods  will  be 
incroduced.  The  second  pare  discusses  Che  judging  mechods  for  che 
I2's.  These  are  discussed  separaCely  primarily  because  Che  daca 
underdecermined  Che  classificaclon  of  che  prococols  inco  Che  classes 
of  mechods  developed  in  Che  firsC  pare.  The  Chird  pare  presence  some 
general  resulcs  abouc  che  use  of  chese  judging  mechods  across  and 
wichin  scudencs. 

Judging  Mechods  for  947^s  and  648^ a 

For  each  judging  meChod,  we  will  describe  Che  meChod,  presenc  Che 
criceria  for  classifying  a  prococol  as  indlcaCive  of  chis  meChod,  and 
discuss  some  illuscracive  examples  of  performance.  The  observed 
judging  mechods  can  be  divided  inco  analyCic  approaches  and 
non-analycic  approaches.  Furcher  divisions  wichin  chese  cwo  general 
approaches  will  be  addressed  in  curn.  We  discuss  che  analycic 


approaches  firsc. 
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Analytic  Judging  approaches .  Analytic  judging  approaches  provide 
anstfers  that  are  necessarily  true.  These  approaches  can  be  divided 
Into  nuaber-lndependent  methods  and  number-dependent  methods.  We  vlll 
discuss  the  number- Independent  methods  first. 

As  their  name  Implies,  number-independent  methods  do  not  use  the 
values  of  the  numbers  In  the  expressions  to  judge  equivalence.  The 
necessary  truth  of  the  number-independent  judging  methods  Is  grounded 
on  the  mathematical  axioms  and  theorems  commonly  found  In  algebra.  We 
will  refer  to  these  axioms  and  theoreau  collectively  as  properties. 
The  students  use  these  properties  In  the  process  of  Judging  the 
equivalence  of  elements  In  a  pair  of  expressions. 

Before  we  discuss  these  methods  further,  we  would  like  to 
Introduce  the  concepts  we  used  to  analyze  these  methods  as  well  as  the 
other  observed  methods.  The  Judging  task  Is  a  procedural  task  that 
must  obey  the  general  constraint  of  equivalence.  Specific  judging 
rules  are  applied  within  the  constraints  of  higher-order  principles 
(Greeno,  Slley,  &  Gelman,  1984).  A  primary  aim  of  our  analysis  of 
performance  on  this  task  Is  to  analyze  the  protocols  in  such  a  way 
that  It  reveals,  to  some  extent,  the  structure  of  methods  used.  We 
describe  higher-order  principles  Informally  to  give  a  sense  of  the 
organization  of  performance,  and  then  describe  specific  realizations 
of  a  principle  that  the  students  used.  We  do  not  claim  that  the 
students  are  conscious  of  these  principles  In  the  form  presented,  only 
that  this  Is  a  possible  organizing  principle  that  underlies  and 
rationalizes  what  they  are  doing.  Also  in  classifying  performance,  we 
have  not  separated  the  correct  uses  of  mathematical  properties  from 
the  Incorrect  uses.  This  Is  consistent  with  the  concern  to  examine 
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the  structure  of  the  methods,  and  uot  the  correctness  of  the  content. 
We  will  however  discuss  the  kinds  of  errors  that  occur,  many  of  them 
should  be  correctable  without  much  difficulty. 

For  oost  of  the  Judging  methods  there  Is  a  version  based  on  a 
unary  parsing  of  the  expressions  and  another  based  on  a  binary 
parsing.  The  general  principle  that  organizes  the  unary  parsing  for 
the  nuiaber^lndependent  methods  Is  that  two  expressions  are  equivalent 
If  the  same  terms  are  added  and  subtracted,  regardless  of  their  order 
In  the  expression.  This  principle  can  be  realized  In  specific 
procedures  that  compare  the  terms  and  operators  between  two 
expressions  to  determine  whether  the  general  principle  has  been 
satisfied.  The  general  principle  that  organizes  the  binary  parsing 
for  nufflber'lndependent  methods  Is  that  two  expressions  are  equivalent 
If  the  binary  pairs  In  the  expression  are  equivalent,  where  one  binary 
pair  can  serve  as  a  term  In  another  binary  pair.  A  number  of 
properties  can  be  used  to  determine  the  equivalence  of  binary  pairs. 
Hera  Is  a  list  of  some  of  the  properties  that  the  students  seem  to 
use: 


A  -  A 

A  +  B  -  A  +  B 
A  +  B  -  B  +  A 
A  -  B  -  A  -  B 
A  +  Q  -  A  +  Q 
A  +  Q  ^  A  -  Q 
A  +  q  -  Q  +  A 


Reflexive 

Reflexive 

Commutative 

Reflexive 

Reflexive,  where  Q  Is  a  binary  pair 
Where  Q  Is  a  binary  pair 
Commutative 
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The  discussion  up  Co  this  point  has  described  a  sec  of  forms 
within  which  equivalence  Jtidglng  can  proceed.  This  Is  a  structural 
level  of  analysis.  We  now  want  to  mention  briefly  two  possible 
psychological  Implementations  chat  would  embody  these  structures.  One 
Is  syntactic;  the  other  is  semantic.  (See  the  General  Discussion  for 
a  speculation  on  a  third  possibility.) 

Syntactic  methods  do  not  use  the  values  of  the  numbers,  one 
simply  notes  whether  they  are  the  same  or  different.  The  unary  method 
would  be  realized  syntactically  by  a  procedure  chat  determines  whether 
Che  same  numbers  (or  symbols)  are  being  added  and  subtracted  together. 
This  Is  Che  method  commonly  used  in  algebra  to  judge  Che  equivalence 
of  two  expressions.  The  binary  method  would  do  Che  sauae  thing,  but 
would  use  pairs,  and  the  properties  described  above  to  determine 
equivalence . 

Semantic  methods  Interpret  the  numbers  In  the  expressions  as 
representing  quantities  of  different  relative  magnitudes  and  use  these 
magnitudes  as  part  of  judging  procedures.  Semantic  procedures  that 
realize  the  unary  and  binary  methods  are  comparable  to  their  syntactic 
counterparts,  processing  the  terms  of  the  expression  In  the  same 
sequence.  They  differ  from  the  syntactic  approach  because  they  view 
numbers  are  viewed  as  standing  for  quantities,  and  decisions  are  made 
using  rules  about  operations  on  quantities. 

In  a  unary  version  of  a  semantic  method,  a  number  that  Is  common 
to  Che  two  expressions  Is  taken  as  a  "starting"  number.  In  the  12 's 
and  Che  947 's  problem  secs,  this  was  usually  the  largest  absolute 
value  and  the  first  number  In  the  expression  (except  for 
685  -  492  -t-  947).  The  students  can  Chen  check  to  see  If  the  same 
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aumbers  are  being  added  and  subtracted  to  this  start  number.  They  can 
verify  that  the  two  expressions  are  equivalent  if  the  same  quantities 
are  being  added  and  subtracted.  The  binary  version  of  this  method 
compares  binary  pairs,  checking  that  the  same  magnitudes  are  being 
added  and  subtracted. 

The  preceding  discussion  has  introduced  the  concepts  that  will  be 
used  to  discuss  the  Judging  methods,  national  inspection  shows  that 
any  method  could  be  realized  in  a  unary  or  binary  form  and  with  a 
syntactic  or  a  semantic  process.  In  practice,  not  all  of  these 
possibilities  are  common,  and  the  available  data  are  not  always 
adequate  in  general  for  making  such  determinations.  These  descriptive 
concepts  are  used  to  the  extent  that  the  distinctions  can  be  made  in 
the  observed  protocols. 

Turning  now  to  examine  specific  cases,  only  binary,  syntactic 
methods  were  observed  for  the  number- independent  methods.  No 
unambiguous  cases  of  unary  processing  or  semantic  processes  were 
observed  for  number-independent  solutions.  Table  4  shows  that  14 
cases  of  number- independent  judging  were  observed  as  well  as  the 
frequency  with  which  the  other  methods  were  used. 

Insert  Table  4  about  here 

Three  criteria,  each  being  sufficient,  were  used  to  classify 
protocols  as  indicative  of  a  syntactic,  number- independent  method*. 
One  criterion  was  statements  in  the  protocol  like  “just  rearrange  the 
numbers'*  or  “just  change  around  the  numbers."  Such  statements  are 
taken  to  indicate  that  the  students  were  looking  at  the  syntactic 
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relations  of  the  numbers.  The  procedures  that  carry  out  these 
operations  do  not  use  the  values  of  the  numbers.  For  example,  Rudolf 
Judged  that  947  -  685  +  492  was  equivalent  to  947  -  492  685.  His 
protocol  was  given  above  In  Case  9,  and  repeated  here.  He  explained: 

Case  9:  947  -  685  +  492  947  -  492  +  685 

I  couldn't  tell  what  the  answer  to  this  problem  was,  I  Just  know 
It.  It  doesn't  matter  that  these  two  are  switched  around.  [B: 
The  685  and  the  492.]  Yeah. 

In  this  ease,  Rudolf  seems  to  follow  a  form  of  a  b  ■  b  a.  Then  If 
these  two  equivalent  binary  pairs  are  represented  by  then 

A  second  criterion  for  classifying  a  protocol  as  a  syntactic, 
number- Independent  parse  was  statements  of  orders  of  operation.  For 
example,  Nick  Judged  648  -f  873  -  597  to  be  eqult^alent  to 
597  -  648  >  873. 

Case  648  +  873  -  597  597  -  648  +873 
You  can  Just  add  these  two  and  subtract  597. 

While  this  statement  Is  telegraphic.  It  Is  Interpreted  as  asserting 
that  648  +  873  Is  equivalent  In  both  expressions,  and  then  the  same 
number  Is  being  subtracted  from  the  equivalent  binary  pair.  His 
statement  was  given  Immediately  and  his  use  of  the  word  just  Is  taken 
to  Indicate  that  he  Is  manipulating  the  expressions  In  terms  of  their 
algebraic  relations.  In  other  words,  the  values  of  the  numbers  In  the 
expressions  are  not  used  (except  for  noting  their  Identity). 

*As  noted  above.  It  Is  possible  that  these  Judgments  could  *"  -> 
been  made  semantically  a^  reported  In  a  syntactic  manner.  However, 
both  the  rapidity  of  the  Judgments  and  the  fact  that  the  students 
already  knew  how  to  recognize  equivalence  by  the  commutative  property 
leave  us  satisfied  with  this  projective  Interpretation. 
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A  third  criterion  was  statements  about  rearranging  the  number  In 
certain  orders.  Stella  also  Judged  648  873  -  597  to  be  equivalent 
to  597  -  648  +  873  explaining: 

Case  648  +  873  -  597  597  -  648  +873 

If  the  648  were  placed  first  and  then  873  and  597  would  be 
exactly  the  same. 

Her  statement  Is  also  telegraphic,  and  she  describes  a  transformation 
that  would  make  the  two  expressions  Identical.  We  take  the 
telegraphic  statement  to  Indicate  that  these  decisions  are  being  made 
syntactically  rather  than  reasoning  with  values  of  the  quantities. 

Another  method  classified  as  a  syntactic,  number-independent 
method  was  the  backwards  method.  The  principle  here  Is  roughly  that 
two  expressions  are  equal  If  their  terms  are  in  reverse  order  and  the 
same  operators  are  present.  To  some  extent,  this  could  be  considered 
a  unary  method.  The  criterion  for  classifying  a  protocol  as 
Indicative  of  a  backwards  judgment  was  unambiguous.  The  students 
stated  this  explicitly.  They  did  not  give  a  rationalization  for  this 
judgment.  Indeed,  their  protocols  suggest  that  It  was  obvious  to 
them,  which  Is  consistent  with  a  syntactic  Interpretation.  An  example 
was  presented  above  In  Case  6  of  the  parsing  analysis.  This  approach 
Is  Included  as  analytic  because  the  students  are  using  some  syntactic 
features  as  a  guide  for  deciding  equivalence,  and  these  features  take 
the  form  of  a  general  rule  that  Is  applied  with  consistency. 

The  analytic,  number-dependent  methods  use  the  semantics  of 
ordinal  values  to  decide  whether  a  pair  of  expressions  are  equivalent 
or  not.  This  system  provides  the  necessary  truth  for  these  methods. 
It  Is  number-dependent  because  one  must  have  the  values  of  the  terms 
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of  the  expressioa  In  order  to  use  this  system.  The  general  principle 
that  organizes  this  performance  Is  the  Idea  that  If  one  expression  has 
a  larger  value  relative  to  the  other,  then  they  cannot  be  equivalent. 
This  determination  could  be  made  with  binary  or  unary  parses.  Mo 
analytic  performance  was  observed  that  could  be  classified  as  unary, 
so  only  the  binary  cases  will  be  considered. 

In  this  method,  the  students  use  the  semantics  of  more  and  less 
In  a  direct,  analytic  manner,  deciding  equivalence  according  to  the 
consequences  of  adding  more  or  less  to  a  quantity.  The  kind  of  rules 
used  here  are  of  the  form:  more  -  less  >  less  -  more.  There  were  two 
main  Instances  In  which  this  method  was  used.  The  first  was  In  the 
comparison  of  597  +  648  -  373  with  both  648  +  873  -  597  and 
873  >  597  -  648.  This  accounted  for  8  of  the  14  observed  Instances  of 
this  method.  Here  is  Joanle's  protocol  in  which  she  Judged  the  first 
expression  to  be  less  than  the  other  two  expressions,  as  did  the  other 
subjects. 

Case  597  +  648  -  873  648  +  873  -  597  873  +  597  -  648 

This  makes  a  smaller  number.  [B:  The  first  two  terms?]  Teah. 

And  then  you  subtract  a  greater  number. 

Protocols  were  classified  as  Indicative  of  an  analytic, 
number-dependent  method  If  they  contained  statements  that  compared  the 
magnitudes  being  added  and  subtracted  between  the  two  expressions  and 
these  comparisons  could  be  made  analytically.  Thus,  In  Case  22,  the 
additive  binary  pair  In  the  latter  two  expressions  had  one  number  In 
common  with  the  additive  binary  pair  In  the  first  expression. 
However,  the  other  number  C373)  In  the  additive  binary  pair  In  the 
latter  two  expressions  was  larger.  Therefore,  one  can  determine  that 
the  value  of  the  additive  binary  pair  for  the  first  expression  Is 
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smaller  than  Che  value  of  Che  addlclve  binary  pairs  for  Che  laccer  cwo 
expressions.  Finally,  one  noces  chac  a  larger  amounc  is  being 
subcracced  from  che  addicive  binary  pair  in  Che  firsc  expression 
compared  Co  che  ocher  cwo  expressions.  This  permics  che  use  of  che 
nile  described  above. 

The  ocher  main  insCance  of  a  number-dependenC  mechod  involved  Che 
rule  chac  posicive  numbers  are  greacer  chan  negacive  numbers.  This 
accounced  for  5  of  che  14  observed  inscances.  For  example,  Rudolf 
(Case  24)  asserced  ChaC  648  -  597  +  873  was  noc  equivalenC  Co 
648  873  -  597.  873  597  -  648.  or  597  643  -  873  because  "None  of 
Che  ochers  would  be  negacive  numbers  and  Chis  one  would  be."  When 
asked  CO  explain  how  he  decided  Chis,  he  explained  how  che  firsc  cwo 
added  up  are  more  chan  che  number  subcracced  and  how  in  Che  negacive 
one,  Che  Cwo  numbers  added  up  were  more  Chan  Che  648.  Desplce  Che 
incorrecC  parsing  of  Che  firsc  expression,  his  Judging  meChod  is  an 
analycic  rule,  based  on  che  relaclve  values  of  Che  numbers.  Frococols 
were  classified  as  indicaclve  of  chis  mechod  when  Che  scudencs 
asserced  chac  one  expression  was  negacive  wd  could  noc  be  equivalenC 
Co  Che  ocher  expressions. 

Non" analycic  approach.  Having  examined  Che  number- independenc 
and  che  number-dependenC ,  analycic  meChods  of  equivalence  Judging,  we 
now  Curn  Co  che  non-analycic  approach.  Non-analyclc  mechods  produce 
answers  chac  do  noc  have  a  logical  syscem  chac  guarancees  che 
necessary  cruch  of  che  conclusions*.  There  were  Chree  general  mechods 

*P lease  noce  chac  we  only  apply  che  analycic  concepc  Co  syscema 
based  on  logics  generally  recognized  as  analycic.  £c  may  be  necessary 
ac  some  poinc  co  augmenc  che  analycic  concepC  wlch  a  cacegory  of 
"personal-analycic"  mechods.  Thac  is,  mechods  based  on  a  consiscenc 
sysCem  of  logic  chac  is  noc  generally  recognized  as  analycic. 
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la  the  non-analTtlc  approach.  They  are  seal-analytic ,  compensatloa, 
and  difference.  These  aethods  are  primarily  number-dependent.  The 
seal-analytic  and  some  of  the  difference  aethods  seemed  to  function  as 
default  aethods  that  the  students  used  tihen  they  could  not  find  a  more 
analytic  approach.  The  seal-analytic  and  the  compensation  aethods 
were  for  the  most  part  semantic  because  students  use  the  relative 
magnitudes  of  the  quantities  and  compare  them  In  terms  of  more  and 
less.  These  two  aethods  are  distinguished  by  the  manner  In  which  the 
semantics  of  relative  magnitude  are  used  In  determining  the 
equivalence  of  a  pair  of  expressions. 

In  the  seal-analytic  method,  the  students  set  up  the  proper 
relative-magnitude  relations  between  the  subexpressions  of  an 
expression,  but  there  are  not  analytic  rules  based  on  the  ordinal 
semantics  that  can  use  these  relations  to  produce  a  decision. 
Instead,  the  students  seem  to  engage  In  a  sort  of  estimation  of  these 
ordinal  quantities.  Thus,  while  the  answers  are  close  approximations, 
they  leave  the  students  with  uncertain  answers  that  are  not  analytic. 

Here  are  two  examples.  The  protocol  for  the  first  example  Is 
given  above  In  Case  13.  It  seems  that  Stella  Is  thinking  something 
along  the  lines  that  a  small  quantity  added  to  a  large  quantity  might 
be  a  little  larger  than  the  two  medluia-slze  quantities  being  added. 
In  another  case ,  Joanle  asserted  that  648  -  597  873  and 
648  4-  873  -  597  were  eo<;lvaleat  because: 

Case  25:  648  -  597  873  648  +  873  -  597 

This  [648  373  -  597]  you  add,  you  get  a  high  number  and  you 
only  subtract  a  little.  And  this  [648  -  597  873]  you  add  a 
lot.  So  I  think  they  should  be  equivalent. 
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It  appears  that  Joaale  Is  making  an  estimation  of  the  sort  that  large 
minus  small  is  equal  to  small  plus  large. 

Two  distinctive  characteristics  were  used  to  classify  protocols 
as  semi-analytic.  Contrary  to  other  methods,  the  students  usually 
hedged  their  assertions  with  statements  like  the  two  expressions 
"might  be  the  same,"  "probably  get  the  same  thing,"  "might  make  up 
for  the  loss,"  or  "might  end  up  to  be  this."  Second,  the  students  did 
not  compare  the  relative  magnitudes  (i.e.,  larger  or  smaller)  of 
subexpressions  between  the  pair  of  expressions  as  they  did  with  the 
analytic  number-dependent  method.  Instead,  they  talked  about  the 
relative  magnitudes  of  the  numbers  within  each  expression,  such  as 
"add  a  high  number,"  "subtract  a  little  nisaber,"  and  "get  a  low 
number."  Finally,  although  not  a  criterion  for  classification,  in 
many  of  these  cases,  students  expressed  uncertainty  abc  '  their 
answers  by  statements  like  "don't  know  exactly,"  and  "can't  really 
tell."  This  is  consistent  with  the  fact  that  this  method  does  not 
provide  an  analytic  solution. 

In  the  compensation  method,  students  use  the  semantics  of  ordinal 
quantities  as  a  cue  to  a  more  general  principle  that  asserts 
equivalence.  This  higher-order  principle  went  something  like  this: 
"Two  expressions  are  equivalent  if  both  sides  get  comparable 
treatment.  If  a  bunch  of  opposites  are  present,  then  maybe  it  will 
all  balance  out."  This  general  idea  takes  a  number  of  different 
forms  and  we  have  not  found  a  general  description  to  characterize 
them.  For  now,  we  will  have  to  communicate  this  general  idea  by 
examples.  Protocols  were  classified  as  indicative  of  a  compensation 
method  if  the  students  asserted  that  the  pair  of  expressions  were 
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equivaleat,  and  if  they  talked  about  the  quantities  Involved  In  terns 
of  more  and  less  or  larger  and  smaller,  and  talk  about  how  one 
operation  was  performed  In  one  expression  and  a  different  operation 
was  performed  In  the  other  expression,  but  that  It  all  comes  out  the 
same.  The  character  of  the  last  step  was  such  that  the  students 
seemed  to  defer  to  the  equivalence  judgment  of  the  principle  rather 
than  using  the  Information  about  the  relative  magnitudes  directly. 

The  compensation  method  seems  robust.  Four  of  the  five  subjects 
used  a  compensation  method  at  least  once.  Also,  It  Is  possible  to 
find  contrasts  that  are  suggestive  of  binary  and  unary  methods  and  of 
semantic  and  syntactic  methods.  In  the  unary  version,  the  students 
used  the  Idea  that  some  quantities  were  being  added  and  subtracted  to 
a  start  quantity,  except  now  they  did  not  pay  attention  to  the  fact 
that  different  quantities  were  being  added  and  subtracted.  Joanle 
judged  that  648  873  -  597.  and  873  4*  597  -  648  were  equivalent 

because : 

Case  648  +  873  -  597  873  +  597  -  648 

You  added  this,  the  highest  number  plus  the  lowest  number,  and 
you  subtracted  the  middle  number.  In  this  you  added  the  highest 
number,  the  middle  number  plus  the  highest  number  and  subtracted 
the  lowest  number.  See  you  subtracted  less  because  you  added 
more.  You  subtracted  more  because  you  added  less.  It  seems 
confusing. 

One  can  see  that  In  this  protocol  Joanle  operates  with  the  relative 
magnitudes  of  the  numbers.  The  two  sentences  before  the  last  one  are 
what  we  take  to  be  Indicative  of  a  compensation  method.  Her  reasoning 
seems  to  follow  an  argument  along  the  lines  of:  addition  and 
subtraction  are  opposite,  these  numbers  are  more  and  less,  so  In  some 
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sense  are  opposite.  If  you  subtract  less  In  one  expression,  then  you 
should  do  the  opposite  In  the  other  expression,  that  Is,  you  should 
add  more.  Similarly,  If  you  take  away  more  In  one  expression,  then 
you  should  add  less  In  the  other.  Because  we  are  compensating  for 
both  numbers  being  added  and  subtracted,  then  It  should  balance. 

We  take  this  to  be  a  unary  method.  In  which  the  873  Is  serving  as 
the  start  number  and  Joanle  Is  examining  the  effects  of  adding  and 
subtracting  the  648  and  the  397.  Also  note  that  her  statement  about 
how  It  Is  confusing  Is  consistent  with  the  claim  that  she  Is  not  tislng 
an  analytic  method,  nor  using  the  magnitudes  of  the  quantities 
directly.  Joanle  did  not  make  comparable  statements  when  comparing 
other  expressions,  however,  just  because  this  Is  confusing  does  not 
mean  that  she  Is  uncertain  about  this  method.  The  Interviewer  told 
her  that  she  could  change  her  mind  If  she  wanted,  but  Joanle 
maintained  that  they  were  equivalent. 

Stella  compared  the  same  pair  of  expressions  with  a  compensation 
method,  but  used  a  binary  version.  In  such  a  method,  one  notes  a 
difference  In  a  binary  pair  and  then  a  compensating  difference  In  the 
other  binary  pair.  Her  protocol  was: 

Case  15: 

If  you  added  873  -t-  397,  you  would  get  a  smaller  number  than  648 
take  away  [sic]  700,  or  873.  And  then  you  take  away  a  larger 
number  and  then  a  smaller  nimber.  So  I  think  It  would  be. 

Stella  made  several  slips  In  which  she  substituted  take  away  for  add 
or  add  for  take  away,  as  did  some  of  the  other  students.  No 
significance  Is  attached  to  It  here.  In  this  protocol,  she  compared 
the  relative  magnitudes  of  the  numbers,  noting  that  the  first  binary 
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pales  would  not  be  equivalent •  but  then  seeas  to  use  a  conpenaatlon 
rule  of  the  form:  Larger  alnus  saaller  equals  smaller  minus  larger. 
The  compensation  schema  here  seems  roughly  as  follows.  The 
description  of  the  two  start  sums  are  semantically  opposite,  and  one 
Is  doing  the  same  operation  of  these  opposites  with  another  set  of 
opposites,  so  It  should  all  balance.  This  protocol  was  classified  as 
compensation  rather  than  seml^analytlc  because  we  presume  that  Stella 
does  not  believe  that  larger  minus  smaller  equals  smaller  minus  larger 
and  that  Instead  she  Is  using  the  meanings  of  the  quantities  as  a  cue 
for  a  more  general  principle  rather  than  as  inputs  to  a  procedure  that 
needed  this  Information  to  make  a  decision. 

The  S3rntac tic- semantic  contrast  In  the  compensation  method  Is 
Illustrated  on  the  pair  of  expressions  947  -  685  492  and 
947  -  492  >  685.  Joanle  seemed  to  use  a  syntactic  method.  Her 
protocol  la  given  above  as  Case  10.  The  compensation  schema  here 
seems  to  be  of  the  following  sort.  Addition  and  subtraction  are 
opposite.  Number  A  and  Number  B  are  different.  The  start  numbers  are 
the  same.  If  I  take  away  A  and  add  B,  then  on  the  other  one  I  should 
add  B  and  take  away  A,  and  It  will  all  balance  out.  Her  use  of  the 
word  "but"  suggests  that  she  Is  using  the  compensation  Idea.  In 
particular  she  seems  to  use  this  word  as  If  to  say,  "I  am  starting  by 
doing  something  that  would  seem  to  make  the  two  expressions 
non-equivalent,  but  then  I  do  something  that  compensates  for  the 
differences  and  returns  them  to  equlvadence."  This  protocol  Is 
described  as  syntactic  because  she  does  not  seem  to  be  using  semantic 
Ideas  of  more  and  less  to  select  the  compensation  rule.  Instead,  she 
seems  to  simply  note  that  different  numbers  are  being  added  and 


subtracted. 
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87  contrast,  on  the  same  pair  of  expressions,  Mary  seems  to  use  a 


semantic  approach.  Her  protocol  was: 


Case  5: 


947  -  685  +  492 


947  -  492  +  685 


Because  in  the  first  one,  you're  taking  away  more,  but  then  you 
add  the  same  amount  you're  taking  away  in  the  second  one. 

This  protocol  seems  to  use  a  comparable  schema  as  the  one  described 
for  Joanie's  protocol,  and  Mary  even  precedes  her  description  of  the 
second  step  with  the  word  but.  The  important  difference  is  that 
Mary's  schema  seems  to  operate  on  the  idea  that  compensating  relative 
quantities  are  being  used,  rather  than  compensating  differences  that 
Joanie  was  tising.  In  this  particular  case,  there  is  no  behavioral 
difference  between  these  two  methods.  However,  we  note  the  existence 
of  this  possible  difference  in  the  psychological  realization  of  the 
compensation  method  because  it  helps  clarify  what  might  be  the 
difference  between  rote  and  meaningful  performance.  This  issue  is 
considered  briefly  in  the  General  Discussion. 


While  we  have  Just  argued  that  a  person  can  come  to  a 
compensation  method  from  a  semantic  route,  it  is  important  to  note 
that  the  meanings  of  the  ordinal  relations  are  not  being  used  to 
determine  mathematical  relationships  as  in  the  analytic  and 
semi-anal ytlc  number-dependent  methods.  The  students  do  not  seem  to 
use  the  meanings  of  more  and  less  as  inputs  to  a  set  of  rules  that 
depend  on  their  meaning  to  make  a  decision.  Instead,  they  seem  to  be 
using  a  general  idea  of  compensation,  fitting  a  relation  between  the 
quantities  into  a  compensation  schema,  that  trades  on  the  verbal 
description  of  the  magnitudes  of  these  quantities. 
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It  aay  be  going  too  far  to  dignify  the  compensation  method  with  a 
description  as  a  principle.  Instead,  it  seems  that  the  semantics 
provides  a  configuration  of  the  right  kinds  of  elements  for  the 
application  of  this  general  rule,  and  the  students  never  bother  to 
cognize  the  relations  between  these  elements.  This  claim  is 
consistent  with  the  observation  that  the  compensation  idea  is  applied 
inappropriately  in  some  cases,  and  correctly  in  others.  This  suggests 
that  the  semantics  of  the  quantities  are  not  used  directly  in  the 
application  of  the  rule  (or  that  the  kids  have  some  incorrect  rules). 

The  final  non-analytic  method  was  called  difference.  Sometimes 
the  students  decided  that  a  pair  of  expressions  were  not  equivalent 
because  there  were  distinct  differences  between  the  two  expressions. 
In  some  cases  it  appeared  to  be  more  like  a  default  method,  used  when 
the  other  methods  could  not  be  applied.  In  these  cases,  their 
statements  were  a  listing  of  differences  rather  coordinating  them  as 
they  did  with  the  other  methods.  Indeed,  one  subject  mentioned  how 
some  pairs  of  expressions  were  "all  messed  up”  and  that  there  was  no 
"pattern"  as  there  were  in  other  pairs.  The  decision  rule  used  here 
seems  roughly  of  the  form:  If  there  are  differences  between  the  two 
expressions,  than  they  are  not  equivalent.  By  contrast,  there  were 
two  instances  of  the  difference  method  that  did  not  appear  to  be 
defaults  and  are  very  suggestive  of  possible  conceptions  that  students 
hold  about  the  structure  of  arithmetic  expressions.  Ve  present  the 
instances  here;  the  theoretical  issue  is  taken  up  in  the  General 
Discussion.  In  the  first  case,  Joanle  (Case  14)  encountered  the 
expression  685  -  492  947  and  had  to  compare  it  with  947  -  635  492 
and  947  ~  492  +  685.  This  was  the  first  time  in  the  interview  that 
she  had  encountered  an  expression  that  did  not  start  with  the  same 
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nuaber,  which  was  also  the  largest  absolute  value.  Her  coaplete 
protocol  was  brief:  "That  goes  la  a  separate  pile  because  the  aumber 
you  start  out  with  Is  lower  thaa  la  this  pile."  This  Is  a  dlffereace 
■ethod  because  she  Is  ootlag  a  dlffereace  betweea  these  two 
expressloas,  aod  does  oot  seem  to  exaalae  the  rest  of  the  expressloas. 

A  slallar  case  occurred  whea  Hary  eacouatered  the  same  sltuatloa. 
She  eveatually  produced  a  seml-aaalytlc  solutloa,  but  her  orlglaal 
aaalysls  was  that  the  expressloa  begloalag  with  S85  was  oot  equlvaleat 
to  the  other  two  because: 

Case  2£:  685  -  492  +  947  947  -  492  +  685 

You  start  out  with  685  [emphasis  added] ,  aod  you  take  away  492 
aad  you  dlda't  take  away  492  la  aay  of  the  other  oaes,  except 
[947  -  492  +  685],  but  you  dlda't  take  It  from  685. 

Mary  also  seems  to  note  that  the  expressloo  starts  with  a  dlffereot 
aumber,  and  places  aa  Importaace  oa  the  fact  that  the  same  pair  of 
aumbers  were  aot  subtracted  from  each  other.  We  have  observed 
comparable  cases  with  other  studeats. 

Judglag  Methods  for  the  12^s 

There  are  at  least  three  specific  reasoas  for  why  the  12' s  are 
aoalyzed  separately.  First,  It  was  difficult  to  classify  the  methods 
used  oa  the  12's  problem  set  uslag  the  coacepts  developed  above.  la 
maay  cases  the  studeats  did  oot  state  their  reasoas  with  the  detail 
fouod  for  the  other  two  sets.  For  equlvaleace  judgmeats,  they 
reported  surface  dlffereaces  between  the  expressloas  as  not  mattering, 
or  described  transformations  that  would  reveal  the  equlvaleace  of  two 
expressloas.  For  judgmeats  of  aonequlvalence,  many  times,  the 
studeats  simply  reported  the  discrepancy  that  led  to  this  judgment. 
Consequently,  It  Is  difficult  to  determine  empirically  whether 
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sCudeats  were  using  analytic  procedures,  difference  rules,  and  so 
forth.  Second,  In  several  cases,  the  students  calculated  or  did 
partial  calculations  for  soae  of  the  expressions.  Frequently,  this 
was  done  to  check  the  correctness  of  their  analysis.  However,  It  may 
also  have  enabled  then  to  generate  nore  sophisticated  explanations 
about  why  a  pair  of  expressions  were  equivalent  or  not.  Third,  the 
numbers  In  the  L2's  expressions  were  small,  and  It  may  have  been 
easier  to  form  a  mental  representation  that  was  more  difficult  to 
articulate.  In  contrast  to  the  other  two  sets  In  which  the  students 
had  to  construct  their  arguments  more  consciously. 

Despite  these  difficulties,  we  want  to  describe  the  performance 
on  two  comparisons.  The  first  comparison  the  students  had  to  make  In 
the  entire  Interview  was  between  12  ~  2  6  and  12  2  6.  Of 
course,  they  all  produced  a  correct  answer.  Vlhat  Is  more  Interesting 
Is  the  diversity  of  descriptions  they  produced  In  giving  this  answer, 
most  of  them  consistent  with  a  syntactic,  number-independent  approach. 
They  are  suggestive  of  subtle  differences  In  how  the  students  are 
conceiving  and  describing  why  these  two  expressions  are  not 
equivalent.  This  will  not  be  developed  here  because  of  the  Inadequacy 
of  the  data,  but  many  of  them  should  be  apparent. 

Stella  reported  that  12-2  and  12+2  are  different.  Note  that 
she  uses  the  word  different  which  contrasts  with  her  discussion  of  the 
648  set  where  she  talks  about  more  and  less.  Nick  said  that  there  was 
a  subtracting  In  one  and  an  adding  In  another.  Both  of  these  are 
suggestive  of  a  binary  analysis.  Hary  reported  that  In  one  expression 
you  are  taking  away  and  then  adding,  while  In  the  other,  you  are 
adding  both  times.  This  seems  more  suggestive  of  a  unary  analysis  and 
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possibly  even  a  semantic  one.  Joanle  noted  that  one  expression  has 
two  pluses  and  the  other  has  a  plus  and  a  minus.  Rudolf  noted  that 
one  expression  had  a  minus  so  It  was  different.  These  last  two  focus 
on  the  operators.  Notice  the  absence  of  talk  about  more  and  less. 
This  was  generally  true  for  all  the  comparisons  In  the  12's  set,  which 
Is  consistent  with  our  suggestion  that  number-independent  methods  were 
used. 


These  protocols  Illustrate  that  even  for  one  of  the  simplest 
equivalence- Judging  problems,  we  find  protocols  Indicative  of  a 
variety  of  approaches  for  reaching  the  same  conclusion. 

The  second  comparison  was  between  12  -  2  -h  6  and  L2  6  -  2.  The 
students  provided  sophisticated  answers  here.  Four  of  the  five  who 
made  explicit  statements  said  something  to  the  effect  that  the  numbers 
were  In  a  different  order,  but  that  It  doesn't  matter  (see  Cases  3,  4, 
7,  and  3).  There  appeared  to  be  a  binary  version  In  which  the 
students  noted  that  12  6  was  equivalent  and  then  two  was  subtracted 
(Case  8).  There  also  appeared  to  be  a  unary  version  In  which  the  12 
Is  treated  as  a  start  quantity  and  that  the  students  recognized  that 
It  did  not  matter  when  the  two  was  subtracted  and  the  six  added.  Just 
that  It  happened  at  some  point  (Cases  3,  4,  7).  This  Is  taken  as 
evidence  that  the  students  are  capable  of  understanding  the  Idea  of 
adding  and  subtracting  respective  quantities  from  a  start  quantity 
will  result  In  equivalent  expressions  regardless  of  the  order  In  which 
the  quantities  are  added  and  subtracted. 

General  Characteristics  of  Judging  Methods 

Having  set  forth  the  different  Judging  methods  we  observed,  we 
now  turn  to  some  general  observations  about  applications  of  these 
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mecbods.  Three  Issues  are  addressed:  (a)  the  extent  to  which 

amber- independent  and  analytic  judging  methods  are  used,  (b)  the 
kinds  of  errors  made,  and  (c)  the  use  of  different  judging  methods 
across  and  within  subjects. 

The  first  issue  examines  the  extent  to  which  the  students  were 
using  number-independent  methods  in  their  solution  efforts.  Each  of 
the  problems  could  be  solved  with  number- independent  methods  if  one 
were  to  use  unary  comparisons.  Because  the  students  did  not  usually 
pursue  such  a  method,  let's  consider  only  those  cases  in  which  binary, 
number-independent  comparisons  can  be  made.  Most  of  these  involve 
only  commutative  transformations.  Table  5  contains  the  five  pairs 
that  occurred  in  the  two  sets.  Performance  on  these  five  pairs  is 
summarized  in  Table  8. 


Insert  Table  5  about  here 


Insert  Table  8  about  here 


Students  compared  these  expressions  directly  for  a  little  over 
half  of  the  possible  opportunities  for  such  comparisons.  Of  these 
comparisons,  only  slightly  over  half  were  number- independent 
comparisons.  And  of  these  number- independent  comparisons,  about 
one-third  were  correct.  A  slightly  more  liberal  tabulating  criterion 
can  be  used,  but  it  does  not  change  the  basic  trend.  The  pair  of 
expressions  947  -  885  +  492  and  947  -  492  +  885  can  be  included  in  the 
analysis  because  they  have  a  pair  of  numbers  that  are  equivadent  under 
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comaucatlvity.  However,  in  Che  context  of  these  two  expressions,  it 
is  not  possible  to  naintain  overall  equivalence  in  an  expression, 
while  cooauting  the  binary  pair.  Ue  can  include  this  case  because  it 
is  an  opportunity  in  which  students  could  use  an  nuober-independent 
approach,  even  if  incorrect.  Table  6  shows  a  slight  proportional 
increase  in  the  extent  to  which  the  students  used  number- independent 
methods,  but  still  we  do  not  find  that  number- Independent  methods  ace 
predominating. 

vniile  there  is  not  strong  evidence  that  the  students  are  inclined 
to  using  number-independent  methods,  another  way  to  view  their 
performance  is  whether  they  are  appealing  to  analytic  methods.  When 
we  examine  how  frequently  students  used  analytic  approaches  compared 
to  non- analytic  approaches,  Chen  a  slightly  more  encouraging  picture 
emerges.  Table  7  shows  Chat  students  found  analytic  solutions  about 
60Z  of  Che  time.  The  non-analytic  solutions  were  evenly  distributed 
among  the  semi-analytic,  compensation,  and  difference  methods  (see 
Table  4). 


Insert  Table  7  about  here 


There  were  individual  differences  in  the  observed  use  of  analytic 
or  non-analytic  approaches  reported  in  Table  7.  It  is  tempting  to 
speculate  chat  these  differences  may  reflect  differences  in  cognitive 
style.  However,  no  conclusions  are  offered  because  of  the  following 
considerations.  In  some  cases,  students  used  a  compensation  method, 
which  would  be  counted  as  non-analytic.  However,  if  they  had  used  Che 
semantics  of  Che  ordinal  values,  as  Rudolf  did  (see  Case  2),  then  they 
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would  produce  an  analytic  solution*  Also,  in  some  cases,  the  students 
simply  did  not  know  what  to  do,  perforce  offering  a  non-analytic 
solution.  For  now,  we  Just  want  to  note  that  students  are  producing  a 
considerable  number  of  analytic  solutions,  and  suggest  that  the 
non-anal3rtlc  ones  may  represent  the  absence  of  adequate  methods  rather 
than  the  existence  of  different  conceptions. 

The  second  issue  concerns  the  kinds  of  errors  made  in  the  judging 
performance.  The  errors  can  be  separated  into  two  kinds.  They  are 
violations  of  algebraic  properties,  and  the  non-analytic  methods.  The 
only  violation  of  algebraic  properties  involved  subtraction.  In  one 
case,  a  student  seemed  to  invert  a  binary  pair  involving  subtraction. 
He  asserted  that  a  -  b  equals  b  -  a  (see  Case  21).  In  a  related  case, 
students  were  asserting  that  inverted  pairs  of  nested  binary 
expression  were  equivalent;  that  is,  g  -  a  equals  a  -  q.  where  ^  is  a 
binary  pair  (see  Case  20).  And  finally,  the  backwards  method  may 
reflect  an  assumption  that  subtraction  can  be  performed  in  either 
direction.  In  short,  it  seems  that  some  of  the  students  are  willing 
to  view  inverted  subtraction  as  equivalent.  The  non-analytic  methods 
are  errors  in  the  sense  that  they  cannot  reliably  produce  answers. 
The  compensation  method  is  striking  because  of  the  confidence  with 
which  the  students  asserted  their  answers.  Here  the  problem  is  not 
with  parsing  nor  with  their  knowledge  of  mathematical  properties.  For 
both  the  compensation  and  the  semi-analytic  methods,  the  students  are 
simply  using  methods  that  are  not  generally  effective  or  which  do  not 
use  mathematical  properties  directly  such  as  the  semantics  of  ordinal 
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The  third  Issues  eoucerns  general  conclusions  that  can  be 
extracted  froa  the  anal3rsls  of  the  judging  methods.  The  observed 
performance  supports  the  following  three  hypotheses. 

1.  Students  are  not  uniform  In  the  range  of  judging  methods  they  use. 

There  were  6  possible  comparisons  In  the  347 's  set  and  LO  possible 
comparisons  In  the  648's  set.  Here  Is  a  count  of  the  number  of 
different  methods  used  by  the  students  across  these  two  sets:  Nick 
(5),  Stella  (4),  Rudolf  (2),  Mary  (4),  Joanle  (4). 

A  good  Illustration  of  this  point  comes  from  Stella  comparing  a 
sequence  of  expressions  In  the  648's  set.  In  the  first  comparison,  she 
did  a  compensation.  Her  protocol  Is  presented  above  In  Case  15.  Then 
on  the  next  expression,  she  used  an  analytic  rule  based  on  the 
semantics  of  ordinal  quantities.  A  comparable  example  was  given  In 
Case  22.  On  the  following  expression  she  used  a  seml-analytlc  method 
comparable  to  another  seml-analytlc  method  of  hers  shown  In  Case  13. 

A  second  Illustration  shows  how  a  student  can  use  a  method  that 
seems  to  represent  the  numbers  as  quantities  and  evaluate  their 
effects,  but  then  shortly  thereafter,  appeal  to  a  general  principle 
without  using  the  Ideas  of  quantity  just  displayed.  Mary  seemed  to 
evaluate  the  12's  expressions  using  an  Idea  along  the  lines  of  adding 
and  subtracting  numbers  from  a  start  quantity.  One  example  was  given 
In  Case  4.  In  a  comparable  example,  she  explained  why  12  -  2  »  6  Is 
not  equivalent  to  12  2  -  6.  because  you  take  away  less  In  one  and 
take  away  more  In  the  other.  This  performance  contrasts  with  her 
performance  In  the  947 's  set.  In  Case  S,  Mary  seems  to  give  a 
compensation  analysis  that  mentions  Ideas  of  taking  away  different 


aaounts  as  found  in  Che  12' a  exaapLes.  Now,  however,  she  does  not  sees 
to  use  Che  same  idea  of  caking  away  dlfferenc  amouncs  as  found  in  Che 
IZ's  example,  inscead  appealing  Co  a  more  general  principle.  Also,  Che 
pair  of  azpressions  chac  she  compared  in  Case  4  are  isomorphic  co  a 
pair  in  Che  947 's  (see  Case  12).  For  Che  L2's  she  used  her  semancic 
mechod.  She  never  compared  Che  isomorphic  pair  in  Che  947 's  because 
she  used  a  backwards  mechod  co  equaCe  ic  wich  anocher  expression  (see 
Case  6).  A  comparable  analysis  for  che  same  expressions  can  be  shown 
for  Joanie. 

The  specific  reasons  for  chis  laccer  phenomenon  are  noc  apparenc 
yec,  hue  a  worchy  candidace  for  exploracion  is  che  difference  beeween 
Che  problem-solving  represencacions  of  che  pairs  of  expressions.  For 
Che  I2's,  Che  scudencs  may  have  been  able  Co  form  approprlace, 
meaningful  relaClons  beeween  che  quancicies,  while  wich  Che  larger 
numbers,  Chey  resorced  co  mechods  ChaC  were  more  syncaccic,  and 
number-dependenc . 

2.  Uniform  mechods  are  noc  used  for  comparing  a  parcicular  pair  of 
expressions . 

For  che  947 's  sec,  chere  were  six  possible  comparisons.  On  five 
of  che  six,  cwo  or  more  differenc  mechods  were  used  across  Che 
colleccion  of  sCudencs,  even  for  cwo  of  Che  comparisons  ChaC  only  had 
cwo  scudencs  responding.  Similarly,  Chere  were  eighc  pairs  of 
expressions  in  che  648 's  sec  for  which  cwo  or  more  scudencs  made 
comparisons.  Six  of  chese  eight  had  ac  lease  two  dlfferenc  mechods 
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Two  specific  examples  Illustrate  this  general  point.  While  three 
of  the  five  students  gave  a  compensation  argument  for  a  pair  of  648 
expressions  (see  Cases  13  and  16),  at  least  one  student  was  able  to 
give  a  correct,  analytic  argument  (see  Case  2).  Along  the  same  lines, 
on  the  pair  that  was  labeled  the  binary  error  In  the  parsing  analysis, 
one  sees  that  some  students  used  an  number- Independent  approach  (see 
Cases  9  and  11),  while  others  used  a  compensation  approach  (see  Cases  5 
and  10). 

3.  Changing  the  context  can  affect  the  Judging  method  used  on  an 
expression. 

Frequencies  are  not  provided  here  because  It  Is  difficult  to 
establish  what  should  be  counted  as  a  change  of  method.  For  example, 
many  of  the  number-dependent  methods  may  be  motivated  by  the  same  basic 
mental  procedure,  but  because  of  strtictural  features  of  the  expressions 
the  student  will  produce  an  analytic,  a  seml-analytlc ,  a  compensation, 
or  a  difference  method.  Consequently,  we  will  simply  present  three 
Illustrations  of  this  point  that  do  not  seem  so  ambiguous.  The  point 
to  be  established  here  Is  that  given  a  particular  expression,  the 
method  of  Judging  will  depend  of  the  expression  against  which  It  Is 
being  compared. 

The  first  Illustration  Is  the  contrast  In  Rudolf's  performance 
with  the  expression  685  -  492  4-  947.  When  he  first  had  to  compare  It 
with  947  -  685  +  492  and  947  -  492  685.  he  asserted  that  these  It  was 
not  equivalent  because  It  was  negative  "Because  It  would  be  this  [492] 
plus  this  [947],  which  equals  more  than  685.  On  the  Immediately 
succeeding  expression,  947  4-  492  -  635.  he  seemed  to  Ignore  what  he  had 
Just  claimed  about  the  first  expression,  and  gave  an  analytic  argument. 
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Ac  first  he  thought  that  they  were  equivaleat,  formiag  an  equivalent 
binary  pair  with  the  947  and  the  492.  However,  he  then  reneabered  chat 
subtraction  was  not  conautative.  He  wrote  on  a  piece  of  paper  i  -  2 
and  2  -  L.  explaining  that  at  first  he  thought  Chat  he  could  do  it 
either  way,  since  this  was  what  one  can  do  with  plus,  but  then 
reaeabered  chat  you  can't  do  chat.  This  is  a  clear  exaaple  of  an 
nuaber-independent ,  binary  method,  and  is  distinctly  different  from 
what  he  had  just  done  with  Che  same  expression  compared  against  two 
other  expressions. 

The  second  illustration  is  Mick's  performance  on  the  expression 
648  873  -  597.  Compared  against  one  expression,  he  produced  a 
compensation  (see  Case  16  for  a  comparable  protocol).  Compared  against 
another  he  produced  an  analytic  solution  (see  Case  22  for  a  comparable 
protocol),  and  compared  against  a  third  he  produced  an 
number- independent  solution  (Case  20).  VRiile  Che  first  two  solutions 
may  have  been  generated  by  the  same  process,  it  is  clear  that  he  has 
produced  a  different  kind  of  solution  in  the  last  case,  even  chough  he 
is  always  judging  the  same  expression  in  these  three  cases. 

The  third  illustration  is  on  Stella's  performance  on  the  947's 
sec.  She  produced  a  binary  error  using  an  number- independent  method 
(see  Case  9  for  a  comparable  example).  Then  comparing  one  of  these 
expressions  with  685  -  492  947.  she  used  a  left-to-rlght  binary  parse 
and  a  semi-anal yclc  method  (Case  13).  Finally,  in  comparing  the  683 
expression  with  another  expression,  she  used  an  number- independent 
method,  but  with  a  different  binary  parsing  (Case  1).  This 
illustration  shows  chat  the  judging  method  used  for  a  particular 
expression  depends  on  the  expression  against  which  it  is  being  judged. 
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General  Discussion 

The  aajor  accoapllshaent  of  this  paper  Is  to  describe  the  parsing 
and  judging  methods  that  some  students  use  to  judge  the  equivalence  of 
three- tera  arithmetic  expressions.  We  take  these  methods  to  reflect 
the  students'  capabilities  for  parsing  and  judging  rather  than  the 
limits  of  their  abilities.  What  Is  especially  attractive  to  us  Is 
that  this  knowledge  seems  to  stand  beyond  any  particular  procedural 
arithmetic  task.  It  seems  to  be  part  of  the  general  conceptual 
knowledge  that  children  have  available  for  reasoning  about  arithmetic 
expressions . 

We  are  pleased  by  the  descriptions  of  these  parsing  and  judging 
methods  because  we  see  them  as  a  descriptive  foundation  for  developing 
a  more  general  and  formal  account  of  students'  structural  knowledge 
about  arithmetic  expressions.  Three  main  points  clearly  emerge 
concerning  the  students'  knowledge  and  application  of  these  methods. 
We  believe  that  a  satisfactory  model  of  prealgebra  students'  knowledge 
of  the  structure  of  arithmetic  expressions  must  accommodate  these 
points.  First,  there  are  a  number  of  different  parsing  and  judging 
methods  that  each  student  uses,  even  with  the  same  expression. 
Second,  students  are  not  limited  to  using  a  particular  kind  of  parsing 
or  judging  method.  In  fact,  they  sometimes  asserted  that  certain 
things  had  to  be  true,  but  then  violated  these  assertions  by  using 
different  methods.  The  flexibility  with  which  the  students  adopt 
different  approaches  In  handling  these  problems  serves  to  motivate  a 
strong  speculation  about  the  nature  of  their  knowledge,  namely,  that 
the  students  are  not  rigid  and  limited  In  their  approaches  to 
understanding  the  structure  of  arithmetic  expressions.  Third,  there 
Is  evidence  that  students  are  able  to  work  with  arithmetic  as 
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traasfomatloas  of  quantities,  as  well  as  ideas  of  coapensation  and 
ordinal  seaanties.  These  three  conceptions  are  all  abstract 
structural  concepts  that  can  serve  to  organize  a  person's 
understanding  about  the  structure  of  an  arithmetic  expression. 

We  acknowledge  that  some  of  the  observed  methods  may  not  be 
well-developed  in  the  sense  that  the  students  are  not  confident  about 
the  correctness  of  them,  or  that  they  have  been  generated  in  response 
to  the  task  they  were  facing.  However,  for  the  present  analysis,  it 
is  not  important  whether  the  students  were  confident  about  the 
correctness  of  their  ideas.  The  observed  methods  were  applied  with 
some  consistency,  on  more  than  one  comparison,  by  each  student.  This 
fact  supports  the  validity  of  the  existence  of  these  different 
methods.  The  tucertainty  we  take  to  reflect  another  problem,  not 
addressed  here,  which  is  that  the  students  are  not  usually  able  to 
differentiate  between  the  mathematically  correct  methods  and  the  other 
methods  that  they  use.  This  latter  claim  is  grounded  on  the 
observation  that  students  asserted  particular  incorrect  analjrses  with 
some  confidence,  and  maintained  them  even  when  the  interviewer 
provided  some  mild  challenge  or  suggestion  that  they  could  change 
their  answer  if  desired. 

General  Conclusions  About  Parsing 

We  want  to  emphasize  that  the  general  conclusions  Just  stated 
support  the  st^gestlon  that  we  cannot  examine  parsing  of  an  aritlnetic 
expression  as  though  it  were  a  uniform  process.  comparable  argummt 
can  be  made  analytically  for  algebra.  Consider  the  difference  in  how 
one  parses  an  expression  when  one  is  trying  to  simplify  it  in  the 
context  of  an  equation  and  when  one  is  trying  to  factor  that 
expression.  These  cases  suggest  that  when  analyzing  parsing  methods, 
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we  Bust  consider  the  task  being  performed  and  the  context  in  which  it 
is  being  done. 

A  second  issue  concerns  aatheaatical  conventions.  The  sequence 
of  operations  for  the  expression  a  -  b  4-  c  can  be  interpreted  in  two 
ways.  We  saw  that  students  tended  to  make  an  interpretation  that 
violated  matheaaticai  conventions.  It  is  important  to  note  that  a 
convention  is  at  issue  here,  and  not  a  mathematical  concept.  These 
students  have  not  been  exposed  to  this  convention,  and  their 
violations  of  it  suggest  that  they  will  not  acquire  it  spontaneously. 
However,  the  acquisition  of  this  convention  provides  a  person  with  an 
important  structural  relation  between  the  minus  sign  in  front  of  the  ^ 
and  in  the  rest  of  the  expression. 

General  Conclusions  about  Judging 

There  are  many  issues  to  be  developed  here  about  origins  of  these 
different  methods,  their  relative  effectiveness,  methods  of  helping 
students  to  eliminate  or  modify  certain  methods.  However,  we  will 
only  reiterate  the  point  made  about  the  parsing.  There  are  a  number 
of  different  methods  that  students  have  and  use,  even  with  the  same 
expression  and  that  we  must  not  view  the  understanding  of  structure  of 
expressions  as  a  singular  process. 

Consistent  with  the  claim  that  the  students  have  a  number  of 
Judging  methods  at  a  structural  level  of  analysis,  we  also  want  to 
claim  that  they  may  have  both  syntactic  and  semantic  implementations 
of  these  methods.  The  semantic  knowledge  can  be  used  to  justify  the 
syntactic  rules.  These  two  different  methods  nay  help  to  clarify  the 
differences  between  rote  and  meaningful  learning.  A  rote  learner 
would  Just  have  the  syntactic  form  and  would  not  be  able  to  generate 
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new  procedures.  By  contrast,  the  semantic  form  of  the  judging  methods 
would  provide  the  foundation  of  applying  these  concepts  (Greeno, 
1983). 


In  discussing  the  concepts  used  for  the  judging  analysis,  we 
mentioned  a  third  possibility  of  an  embodiment  of  the  structure  of  the 
judging  methods.  We  call  It  knowledge  of  arithmetic  outcomes.  It  Is 
a  middle  ground  between  a  pure  syntactic  approach  and  a  semantic 
approach.  In  this  approach,  the  numbers  themselves  are  the  meaningful 
elements,  with  their  meaning  based  on  viewing  the  numbers  as  an 
asymmetric,  transitive  ordering.  Wow,  one  can  reason  about  more  and 
leas,  but  Instead  of  applying  It  to  physical  quantities  (as  the 
semantic  approach  does) ,  It  would  be  applied  to  the  relative  position 
In  the  ordering  of  the  numbers.  This  notion  needs  to  be  developed 
further,  but  It  seems  to  capture  our  Intuition  about  how  we  reason 
about  these  problems. 

Boundary  Conditions 

This  analysis  of  structural  knowledge  was  conducted  on  only  one 
task  that  could  be  used.  Other  tasks  such  as  rearranging  expressions 
while  preserving  equivalence  may  tap  additional  Important  assumptions 
that  students  hold  about  the  structure  of  arithmetic  expressions.  For 
example,  the  two  protocols  presented  under  the  difference  judging 
method  are  suggestive  of  the  possibility  that  some  students  view  the 
first  number  of  an  expression  as  an  Important  determinant  of  the 
equivalence  of  two  expressions  (Joanle,  Case  14),  and  that  equivalence 
depends  on  the  same  numbers  be  added  and  subtracted  from  each  other 
(Case  26).  We  saw  comparable  cases  among  other  students,  and  this  may 
be  worthy  of  systematic  exploration.  It  should  be  noted  however  that 
like  the  other  methods,  this  concept  does  not  seem  to  limit  the 


Algebraic  Tasks 


Page  65 


studeats.  Joaale  was  able  to  reason  about  expressions  that  did  not 
have  the  same  start  number  (Case  16). 

The  analyses  presented  here  have  established  the  existence  of 
different  parsing  and  judging  methods,  and  noted  the  range  and 
flexibility  of  their  used  by  Individual  students.  We  have  not 
addressed  the  question  of  the  conditions  under  which  these  different 
methods  are  used  nor  the  specific  boundary  conditions  on  the 
particular  parses  and  judging  methods  that  were  observed.  Among  other 
things,  answers  to  this  question  should  help  to  clarify  reasons  for 
the  apparent  differences  In  the  judging  methods  between  the  one-dlglt 
and  the  three-digit  problems  sets,  and  why  some  problems  are  handled 
with  a  compensation  method,  while  others  are  handled  correctly  with  a 
analytic,  number-dependent  method. 

Educational  Implications 

There  are  three  points  to  be  made.  First,  we  think  the  most 
Important  Implication  of  these  results  Is  that  they  provide  a 
foundation  for  further  scientific  investigation  Into  the  nature  of 
arithmetic  knowledge.  The  analysis  presented  In  this  paper  suggests 
that  knowledge  of  the  structure  of  arithmetic  expressions  Is 
multi-faceted,  and  has  offered  a  first  attempt  at  specifying  the 
facets.  Much  scientific  work  remains  In  characterizing  this  knowledge 
more  explicitly  and  completely,  examining  how  It  Is  acquired,  the 
degree  to  which  It  Is  coordinated,  and  the  conditions  for  extension  or 
modification  of  this  knowledge.  Such  a  knowledge  base  can  serve  to 
underpin  educational  efforts. 
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Second,  Che  analyses  have  revealed  two  conceptual  weaknesses  chat 
could  probably  be  addressed  directly  and  lomedlately  in  Che  present 
ciirriculuD.  The  first  is  that  subtraction  cannot  be  coouauted.  This 
can  be  Caught  by  computing  Che  effect  of  inverting  subtraction.  This 
method  was  usually  effective  for  communicating  this  point  to  students 
in  some  pilot  instructional  studies  we  conducted.  The  second 
conceptual  weakness  is  Che  canonical  interpretation  of  expressions 
from  a  lefc-to-righc  form  when  mixed  operations  are  present.  Students 
do  not  encounter  such  expressions  in  arithmetic,  but  it  may  be 
worthwhile  to  introduce  this  issue  into  the  curriculum  earlier  Chan 
algebra,  especially  because  instruction  on  this  point  should  probably 
involve  physical  models  and  may  help  to  provide  a  better  conceptual 
understanding  of  arithmetic. 

The  third  point  concerns  the  implications  of  this  work  for  Che 
design  of  arithmetic  instruction.  A  recent  report  by  the  National 
Council  of  Teachers  of  Mathematics  (L98L)  notes  widespread  support  for 
the  notion  that  the  concept  of  basic  skills  must  encompass  more  Chan 
computational  facility.  The  report  also  noted  that  70Z  of  the 
professionals  at i  laypeople  they  interviewed  expressed  their  belief  in 
the  importance  of  including  instruction  in  the  elementary  curriculum 
concerning  generalizations  about  number  patterns.  The  cask  we  have 
examined  is  not  in  the  curriculum  at  present,  but  it  provides  a  task 
Chat  may  help  children  to  develop  some  generalizations  about  number 
patterns.  The  analysis  provides  some  guidance  for  how  it  might  be 
used  to  develop  specific  mathematical  concepts.  Specific  developments 
are  beyond  the  scope  of  the  work  presented  here,  so  we  limit  our 
remarks  to  the  following  general  point. 
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If  one  were  trying  to  develop  a  curriculum  that  would  foster  a 
conceptual  understanding  of  arithmetic,  then  the  present  analysis 
provides  an  Important  hypothesis  concerning  the  point  of  departure  for 
developing  relevant  Instructional  materials.  It  seems  that  by  the 
sixth  grade,  children  may  already  have  many  of  the  kinds  of  concepts 
they  need  to  reason  about  the  conceptual  structure  of  arithmetic*. 
Thus,  Instructional  efforts  could  concentrate  on  developing 
appropriate  constraints  on  these  Ideas,  as  opposed  to  the  much  more 
difficult  objective  of  cooimunlcatlng  the  basic  Ideas  In  the  first 
place.  If  we  were  to  pursue  this  hypothesis  In  an  Instructional 
experiment,  we  would  try  to  make  the  different  parsing  and  judging 
methods  described  here  explicit  to  the  students,  and  help  develop  an 
understanding  of  the  advantages  and  disadvantages  of  different  ones 
and  the  reasons  for  why  some  are  correct  and  some  are  not.  We  have 
done  this  Informally  using  physical  models.  We  found  that  students 
need  to  see  the  computational  consequences  of  the  different  methods 
before  they  are  willing  to  accept  the  analytic  arguments. 


*Thls  hypothesis  must  be  tempered  by  the  fact  that  above-average 
children  were  examined,  hence  It  Is  Important  that  the  hypothesis  be 
tested  on  a  more  representative  sample  of  students. 
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Table  1 

Problem  Seta  Given  to  Students 
For  Squlvalenee  Judglog 


12's  set 
12-2  +  6 
12  +  2  +  6 
12+2-6 
12+6-2 


947 's  set 
947  -  685  +  492 
947  -  492  +  685 
685  -  492  +  947 
947  +  492  -  685 


648's  set 
648  +  873  -  597 
873  +  597  -  648 
597  +  648  -  873 
648  -  597  +  873 


597  -  648  +873 
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Table  2 

Correetaess  of  Boutvalence  Judging 
for  the  Three  Problem  Sets 


Student 

Problem  Set 

12'a 

947 's 

648's 

C 

IC 

NC 

C 

IC 

MC 

C 

IC 

NC 

Nick 

3 

0 

3 

2 

1 

4 

1 

Mary 

4 

0 

2 

3 

3 

0 

3 

2 

5 

John 

3 

0 

3 

2 

4 

0 

1 

4 

5 

Joanie 

6 

0 

0 

3 

3 

0 

5 

2 

0 

Rudolf 

4 

0 

2 

3 

3 

0 

8 

2 

0 

Stella 

4 

0 

2 

1 

3 

0 

3 

3 

4 

Total 

24 

B 

12 

15 

16 

L 

25 

17 

18 

Note.  C  "Correct;  IC"lacorrect; 

NC"No  cooaent,  there  was  ao  explicit  comparison 
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Table  3 

Frequency  of  Observed  Parsing  Categories 
for,  the  Three  Problea  Seta 


Problea  Sec 

Parsing  Type 

L2's 

94  7 's 

648's 

Whole 


Binary 

2 

LI 

22 

Unary 

6 

0 

L 

Le£t-to-rlght 

1 

8 

3 

Backwards 

0 

2 

L 

Partial 

Operators 

4 

0 

L 

First  additive  pair 

2 

0 

3 

Subtracting  one  tera 

2 

0 

2 

First  nuaber 

0 

2 

0 

Other 

Calculated 

L 

0 

0 

Uninterpreted 

L 

0 

0 

Total 


L9 


23 


33 
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Table  4 

Frequeaey  of  Observed  Judging  Methods 
for  the  947 "s  and  648"s  Problem  Sets 


Judging  Methods 

947 's 

Problem  Set 

648 's 

Analytic 

Number- Independ ent 

3 

6 

Number-dependent 

2 

L2 

Subtotal 

LO 

18 

Non- analytic 

Seml-analytlc 

2 

5 

Compensation 

4 

4 

Difference 

5 

2 

Subtotal 

11 

11 

Grand  Total 

21 

29 
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Table  3 

Pairs  of  Sxpressloas  that  Have  Nuaber-Indepeadent  Binary  Solutloas 


685  -  492  +947 
648  +  373  -  597 
873  +  597  -  648 
873  +  597  -  648 
648  -  597  +873 


947  +  492  -  685 
597  -  648  +  373 
648  -  597  +873 
597  -  648  +  873 
597  -  648  +  873 
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Table  6 


Prequency  of  Muiaber-Iadepeadeat  Judging  Rules  Daed  for  Appropriate 
Pairs  of  Exoresalona  In  the  947 ‘"a  and  648 ‘'s  Problem  Sets 


Response 

Classification  Criterion 

Strict 

Liberal 

Correct  Number- Independent 

3 

3 

Number-lndependentC  a) 

8 

L3 

Total(b) 

14 

L9 

Posalble( c) 

25 

30 

Mote«  (a)  Number- ladependeat  refers  to  the  number  of  algebraic 
judging  rules  that  were  used  among  the  Total 
comparisons  made. 

(b)  Total  refers  to  the  number  of  comparisons  that 
students  actually  made. 

(c)  Possible  refers  to  the  number  of  comparisons  that 
could  have  been  observed  for  the  relevant  pairs  of 
expressions. 
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Tabls  7 

Frsqusacy  of  Aaalycle  and  Soa-anaiycle  Judging 
Rules  for  tha  947 ‘'s  and  648''s  Problea  Secs 


Student 


Analytic  Monranalytle 


Nick 

Mary 

John 

Joanle 

Rudolf 


7  5 
2  6 
1  0 
3  7 
10  0 


Stella 


5 


4 
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Rudolf 

,121 


Scalla 


Figure  la  Dlffereac  parses  of  same  pair  of  expressloas  In  IZ's  set. 


Rudolf 


Joanle 

947  -  685  +  492  947  -  492  +  685 


Figure  2.  Different  parses  of  same  pair  of  expressions  In  947 's  set. 


Stella 


Figure  3a  Different  parses  of  same  pair  of  expressions  In  947''s  set 
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947  -  685  +  492 


7  -  492  +  685 


947  -  685  +  492  947  +  492  -  685 


Plgure  4.  Nick's  dlfferene  parses  of  the  same  expression  In  947‘'s  see 


Stella 


947  >  685  +  492  685  >  492  947 


Figure  5.  Stella's  different  parses  of  the  same  expression  in  947 's  set 


Two  different  parses  of  same  pair  of  expressions  In  648' s  set 
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